Invited reviewThe mismatch negativity (MMN) in basic research of central auditory processing: A review
Keywords
1. The mismatch negativity (MMN): an introduction
In the present article, we will review the recent literature on the auditory mismatch negativity (MMN; Näätänen et al., 1978, Näätänen, 1979, Näätänen and Michie, 1979), a change-specific component of the auditory event-related brain potential (ERP). We will focus on MMN studies of basic cognitive brain research.
Recently, MMN studies of the central auditory function have become very popular. This is because the MMN has opened an unprecedented window to the central auditory processing and the underlying neurophysiology, affected in a large number of different clinical conditions. The MMN enables one to reach a new level of understanding of the brain processes forming the biological substrate of central auditory perception, the different forms of auditory memory, as well as the attentional processes controlling for the access of auditory sensory input to conscious perception and higher forms of memory. In addition to its magnetoencephalographic (MEG) equivalent MMNm (Hari et al., 1984, Csépe et al., 1992, Levänen et al., 1993, Levänen et al., 1996), the MMN also has its optical imaging (OI) (Rinne et al., 1999b, Tse et al., 2006), functional magnetic resonance imaging (fMRI) (Celsis et al., 1999, Opitz et al., 2002, Molholm et al., 2005), positron emission tomography (PET) (Tervaniemi et al., 2000a, Dittmann-Balcar et al., 2001, Müller et al., 2002), and intracranial (Kropotov et al., 1995, Kropotov et al., 2000, Halgren et al., 1995, Baudena et al., 1995, Liasis et al., 1999, Liasis et al., 2000a, Liasis et al., 2000b, Liasis et al., 2001) equivalents.
The “traditional” MMN is generated by the brain’s automatic response to any change in auditory stimulation exceeding a certain limit roughly corresponding to the behavioural discrimination threshold. The MMN is illustrated in Fig. 1. An analogous response occurs in the other sensory modalities, too; in the somatosensory modality (Kekoni et al., 1997, Shinozaki et al., 1998, Akatsuka et al., 2005, Akatsuka et al., 2007), in the olfactory modality (Krauel et al., 1999; for a review, see Pause and Krauel, 2000), and in the visual modality (Alho et al., 1992, Tales et al., 1999, Heslenfeld, 2003, Maekawa et al., 2005, Fu et al., 2003, Czigler et al., 2002, Czigler et al., 2004, Pazo-Alvarez et al., 2003, Stagg et al., 2004, Astikainen et al., 2004; see, however, Kenemans et al., 2003, Kimura et al., 2005, and Nyman et al., 1990; for reviews, see Pazo-Alvarez et al., 2003, Maekawa et al., 2005, Czigler, in press). Fig. 1. (Left) Frontal (Fz) event-related potentials (ERPs) (averaged across subjects) to randomized 1000 Hz standard (80%, black line) and to deviant (20%, green line) stimuli of different frequencies (as indicated on the left side). (Right) The difference waves obtained by subtracting the standard stimulus ERP from that of the deviant stimulus for the different deviant stimuli. Subjects were reading a book. Adapted, with permission, from Sams et al. (1985a).
Moreover, the MMN is also elicited by different kinds of abstract changes in auditory stimulation such as grammar violations in mother-tongue sentences – these higher-order MMNs will be reviewed in later sections of this article.
The MMN response is seen as a negative displacement in particular at the frontocentral and central scalp electrodes (relative to a mastoid or nose reference electrode) in the difference wave obtained by subtracting the event-related potential (ERP) to frequent, “standard”, stimuli from that to deviant stimuli. Here one has to take into account the possible differences in the obligatory ERPs between standards and deviants, however. These differences may result from physical stimulus differences between standards and deviants and from differences in the refractoriness of the neural populations activated by the two stimuli because of the probability difference (see Walker et al., 2001). These differences in the obligatory components are, in general, rather small in amplitude and mainly involve the N1 time zone, however; therefore post-N1 measurements of the MMN usually provide quite reliable estimates of the “genuine” MMN. In addition, the MMN usually reverses polarity in nose-referenced mastoid recordings. See also Deacon et al. (2000).
The MMN usually peaks at 150–250 ms from change onset, with this peak latency getting shorter with the increasing magnitude of stimulus change (Sams et al., 1985a, Tiitinen et al., 1994, Näätänen et al., 1989a, Näätänen et al., 1989b, Amenedo and Escera, 2000). A prerequisite of MMN elicitation is that the central auditory system has, before the occurrence of the deviant stimulus, been able to form a representation of the repetitive aspects of auditory stimulation (Winkler et al., 1996a, Winkler et al., 1996b, Horváth et al., 2001; see also Winkler et al., 1999a, Winkler et al., 1999b, Huotilainen et al., 1993, Paavilainen et al., 1993a; for a review, see Näätänen and Winkler, 1999). An MMN is then elicited by a stimulus that violates this representation. The majority of studies used simple paradigms in which frequent and infrequent stimuli (e.g., tones of 1000 and 1100 Hz, respectively) were presented in a random order, with the infrequent sound eliciting an MMN (Näätänen et al., 1978, Sams et al., 1985a). The MMN can, however, also be elicited by changes in complex stimuli such as speech sounds (Dehaene-Lambertz, 1997, Näätänen et al., 1997) and even by stimuli that deviate from an abstract rule followed by the ongoing auditory stimulation such as a tone repetition in a sequence of descending tones (Tervaniemi et al., 1994a); i.e., even when there is no acoustically constant standard stimulus (see Fig. 2). Fig. 2. (a) Spectrum of an individual Shepard sound that, when presented in ascending or descending sequences of 12 sounds in one semitone step, causes a pitch to ascend or descend in an endless manner. One Shepard sound consists of 10 frequency components, of one octave apart, with a bell-shaped spectrum. While a 12-tone series of Shepard sounds is delivered, the tone-height (which is equivalent to the sense of octave) perception is made to disappear by manipulating the sound spectrum. (b) A visual analogy of the Shepard illusion, the endlessly ascending or descending stairs. (c) The ERPs recorded at the frontal (Fz) elecrode from reading subjects to Shepard (left) and sinusoidal (right) tones (thin line: standard stimulus; thick line: deviant stimulus). The left column shows a regularly descending Shepard sound sequence randomly replaced by a repeating (top) or an ascending (bottom) tone (deviant). The right column: regularly descending sinusoidal tone sequence with occasional repetitive (top) or ascending (bottom) deviants. The arrow indicates the deviant-stimulus onset and the shadowed area the statistically significant part of the mismatch negativity. Adapted, with permission, from Tervaniemi et al. (1994a).
Very importantly, in particular in view of the clinical and other potential applications, the MMN is elicited irrespective of the subject or patient’s direction of attention (Näätänen, 1979, Näätänen, 1985, Näätänen et al., 1978). Hence, no behavioural task is needed; in fact, such tasks are used to direct the subject’s attention away from the MMN-eliciting stimulus sequence in order to prevent the elicitation of attention-dependent ERP components (e.g., the N2b; Renault and Lesévre, 1978, Renault and Lesévre, 1979, Näätänen et al., 1982, Sams et al., 1985a, Sams et al., 1990, Novak et al., 1990, Novak et al., 1992; for a review, see Näätänen and Gaillard, 1983) overlapping the MMN.
The MMN gets a contribution from at least two intracranial processes: (1) a bilateral supratemporal process generating the supratemporal MMN subcomponent (and the polarity-reversed “MMN” in nose-referenced mastoid recordings), and (2) a predominantly right-hemispheric frontal process, generating the frontal MMN subcomponent (Näätänen et al., 1978, Giard et al., 1990, Baldeweg et al., 1999, Rinne et al., 2000). The supratemporal component is, presumably, associated with pre-perceptual change detection, whereas the frontal component appears to be related to involuntary attention switch caused by auditory change (Näätänen et al., 1978, Näätänen and Michie, 1979, Giard et al., 1990, Rinne et al., 2000, Escera et al., 1998, Schröger, 1996a, Schröger, 1996b). The MMN generators reflect the nature of the stimulus, e.g., they usually are left lateralized for language stimuli (Näätänen et al., 1997, Shtyrov et al., 2005, Pulvermüller et al., 2003).
2. Memory dependence of MMN elicitation
The MMN depends on the presence of a short-term memory trace in the auditory cortex representing the repetitive aspects of the preceding auditory events, which usually lasts for a few seconds. Therefore, single sounds, even deviants, with no preceding sounds during the last few seconds elicit no MMN but rather enhanced obligatory responses P1, N1, and P2 (Näätänen and Picton, 1987, Korzyukov et al., 1999). Hence, the MMN seen in the difference wave delineated by subtracting the standard-stimulus ERP from that to the deviant stimulus is not simply due to a larger exogenous response to an infrequent than frequent stimulus (for a review, see Näätänen et al., 2005). The MMN is rather composed of, at least mainly, the outcome of a discrimination process where the deviant event is found to be discongruent with the memory representation of the preceding stimuli (even in the absence of attention).
However, as already mentioned, fresh afferent neural populations activated by deviant stimuli such as those of a clearly different frequency often contribute to the difference-wave negativity, usually to its early part (the N1 time zone Näätänen et al., 1988). Moreover, standards and deviants might elicit different exogeneous responses even when each is presented alone in a stimulus block (e.g., tones of very different frequency or duration; for a review, see Näätänen and Picton, 1987). For this reason, the difference wave is often formed by subtracting the ERP to a given stimulus when it is presented as a standard in one stimulus block from that elicited by the same stimulus when it is presented as a deviant in another block (e.g., Deacon et al., 2000).
Furthermore, a controlled protocol, introduced by Schröger and Wolff (1996), can be used for disentangling the N1 and ‘genuine’ MMN components from one another. It allows one to separate the N1 and MMN mechanisms, for instance by controlling for differential states of refractoriness of the feature-specific afferent neurons in the MMN to frequency changes (Jacobsen and Schröger, 2001). Similar results were obtained for MMNs to changes in location, duration, and intensity (Schröger and Wolff, 1996, Jacobsen and Schröger, 2003, Jacobsen et al., 2003a, see also Jacobsen et al., 2003b). These studies yield strong evidence for the memory-based comparison account of the MMN.
The memory-trace interpretation is supported, among other things, also by results as follows (for a review, see Näätänen et al., 2005):
- (1)
The lack of any MMN-type of response to the first stimulus of a sequence (Cowan et al., 1993, Sams et al., 1985b) or to stimuli, either standards or deviants, presented with very long inter-stimulus intervals (ISIs) (Mäntysalo and Näätänen, 1987, Näätänen et al., 1987a, Kraus et al., 1993a, Kraus et al., 1993b; for a review, see Sokolov et al., 2002). Thus, the MMN is not elicited per se by any stimulus, without a few preceding repetitions of a different stimulus (standard) preceding this stimulus. This indicates that a response to the relation of the present stimulus to the representation of the preceding stimuli is involved;
- (2)
the MMN elicited by a decrement of stimulus duration (Näätänen et al., 1989b, Paavilainen et al., 1991, Kaukoranta et al., 1989), ISI (Ford and Hillyard, 1981, Nordby et al., 1988b, Hari et al., 1989a, Näätänen et al., 1993c, Rüsseler et al., 2001), or stimulus intensity (Fig. 3). These large, long-duration MMNs cannot be explained by new afferent neurons;
Fig. 3. Grand-avarage frontal-pole (Fpz), frontal (Fz), central (Cz), and parietal (Pz) difference waves obtained by subtracting the response elicited by the 80-dB standard tone from the responses elicited by devaint tones of 6 different intensity levels presented in separate blocks. The N1 latency is marked to point out that whereas the N1 amplitude increases with increasing deviant-tone intensity (independent of the standard-tone intensity), the mismatch negativity (MMN) amplitude increases and the MMN peak latency decreases with increasing magnitude of deviation from the standard (i.e., for deviants being both louder and softer than the standard). From Attention and Brain Function (p. 142) by R. Näätänen, 1992. Copyright 1992 Lawrence Erlbaum Associates, Inc. Reprinted with permission.
- (3)
the MMN elicited by the omission of an element of a compound stimulus (Nordby et al., 1991, Winkler and Näätänen, 1993), stimulus omission in a stimulus sequence presented at a very fast constant rate (Yabe et al., 1997, Yabe et al., 1998, Rüsseler et al., 2001), or by the omission of the second of two paired stimuli repetitively presented with a short constant stimulus-onset asynchrony (SOA) (Tervaniemi et al., 1994b);
- (4)
the long peak latency and duration of the MMN in particular for minor stimulus changes (e.g., Näätänen et al., 1989a, Näätänen et al., 1989b) or for changes in complex sounds such as speech sounds, which are atypical to the afferent responses (e.g., Näätänen et al., 1997);
- (5)
the generator-loci differences between the N1 (and the other afferent responses) and the MMN, to be reviewed later;
- (6)
the differential sensitivity of the MMN and the afferent responses to different manipulations such as the administration of an NMDA-receptor antagonist (Javitt et al., 1996, Umbricht et al., 2002);
- (7)
the very different developmental trajectories of the N1 (Kurtzberg et al., 1995, Pang and Taylor, 2000) and the MMN: in contrast to the N1, the MMN can be recorded in newborns (Alho et al., 1990) and even before (Draganova et al., 2005, Huotilainen et al., 2005).
- (8)
the different generator constellations underlying MMNs elicited by stimuli yielding higher-level cognitive processes. These MMN-generator constellations are in a surprisingly good agreement with the brain-activation patterns seen during the respective cognitive processes. For example, the MMN elicited by syntactic errors shows activation in left perisylvian areas where syntactic processing is known to be housed, and the generators of semantic MMN activity agree with the brain loci of semantic memory networks revealed by a range of neuroimaging experiments (for a review, see Pulvermüller and Shtyrov, 2006).
These findings belong to the central evidence for the cognitive or memory interpretation of the MMN: it is elicited when the sensory input does not “match with” the representation of the preceding standard stimuli (see also Laufer and Pratt, 2005). Thus, in recording the MMN to deviant stimuli, one appears to be probing the neural representation of the standard stimulus, with the MMN response reflecting the detection of a difference between the deviant and standard auditory events and hence providing an objective index for auditory discrimination accuracy. Therefore, the MMN also provides, indirectly, a measure of the accuracy of the neural representation of the standard stimulus (see Näätänen and Alho, 1997). Consequently, the MMN opens a unique window to the perceptual and memory functions of the auditory cortex.
The sensory information carried by the sensory-memory traces underlying the MMN generation indeed corresponds to sound perception and memory (and thus provides the central sound representation, CSR), rather than just to the acoustic elements composing the stimulus (Näätänen and Winkler, 1999). This was demonstrated, e.g., by Winkler et al. (1995) who found an MMN to a change of the missing fundamental, with both the standards and deviants being composed of varying combinations of the same simple tonal elements.
The results of several studies adding a backward-masking stimulus to the oddball paradigm (Winkler et al., 1992, Winkler et al., 1993, Bazana and Stelmack, 2002) also suggested that the MMN reflects sensory (echoic) memory in audition (for reviews of different forms of auditory sensory memory, see Cowan, 1988; see also Winkler and Cowan, 2004), with the traces underlying this memory being probed by presenting deviant stimuli (for a review, see Näätänen and Winkler, 1999).
As already mentioned, traces of a relatively short duration are involved in MMN generation (see, however, Cowan et al., 1993, Atienza et al., 2001, Atienza et al., 2004, Jääskeläinen et al., 1999a, Winkler and Cowan, 2004, Winkler et al., 1996a, Winkler et al., 1996b). In young, healthy subjects, these traces can last for about 5–10 s, judging from the ISIs that still permit MMN elicitation (Böttcher-Gandor and Ullsperger, 1992, Näätänen et al., 1987a, Mäntysalo and Näätänen, 1987, Sams et al., 1993; see also Ritter et al., 2002), but the trace duration gets shorter with aging (Jääskeläinen et al., 1999b, Pekkonen et al., 1996). Furthermore, this age-dependent shortening of the memory trace is expedited by chronic alcoholism (Polo et al., 1999, Grau et al., 2001), and these traces are very short in duration in patients with neurodegenerative brain diseases such as Alzheimer’s disease (Pekkonen et al., 1994, Pekkonen, 2000). Grau et al. (1998) developed a new paradigm to determine the duration of these traces in a much shorter time than is usually needed.
In the beginning of a stimulus block, the standard stimulus has to be repeated for a few times before a deviant stimulus can elicit an MMN (Cowan et al., 1993, Winkler et al., 1996a, Winkler et al., 1996b). In addition, the MMN amplitude gets larger with the increasing number of standards preceding a deviant (Sams et al., 1983, Imada et al., 1993a, Imada et al., 1993b, Baldeweg et al., 2004, Haenschel et al., 2005, Javitt et al., 1998). The MMN elicitation early in a block may, however, be facilitated by the standard stimulus of the block being identical to that of the preceding block (Cowan et al., 1993, Winkler et al., 1996a, Winkler et al., 1996b). This suggests that the sensory-memory traces probed with the MMN in the traditional passive oddball paradigm might yield a conservative estimate of the duration of the short-term sensory memory trace in audition (see also Winkler and Cowan, 2004, Winkler, Kujala et al., 2003a). Moreover, subsequent studies showed that the MMN can also be used for probing long-term or permanent memory traces in audition such as those serving speech perception or the recognition of familiar voices, as will be reviewed later in this article.
In addition, the rate at which standards are presented is of course of importance to trace formation and maintenance. With shorter ISIs between the standards, the MMN amplitude tends to get larger (Näätänen et al., 1987a, Sabri and Campbell, 2001, Javitt et al., 1998; see also Alain et al., 1994). For corroborating fMRI data, see Sabri et al. (2004).
3. Deviant-stimulus probability
The MMN amplitude is decreased by increasing the deviant-stimulus probability (Näätänen et al., 1987a, Ritter et al., 1992, Sabri and Campbell, 2001, Haenschel et al., 2005, Sato et al., 2000, Sato et al., 2002). This is partially due to the standard-stimulus being more often replaced by deviant stimuli (and cannot then contribute to trace strength) than they are with smaller deviant-stimulus probabilities. A more important factor, however, appears to be the fact that with shorter deviant-stimulus intervals, these stimuli develop a trace of their own, which in turn might inhibit MMN generation with regard to the initial standard (Sams et al., 1984, Ritter et al., 1992, Rosburg, 2004, Rosburg et al., 2004a, Rosburg et al., 2004b). In fact, an early account of the MMN (Näätänen, 1984) explained the MMN phenomenon in terms of the input from the eliciting deviant stimulus “starting” to develop the representation of its own in the auditory sensory-memory system already engaged by the representation of the preceding stimuli (cf. Donchin’s influential context-updating hypothesis of the P3 (Sutton et al., 1965); Donchin, 1981, Karis et al., 1984, Donchin and Coles, 1988, Donchin and Coles, 1991; see also Javitt et al., 1996, Winkler et al., 1996a, Winkler et al., 1996b, Sussman and Winkler, 2001). Subsequently, three different studies (Sato et al., 2000, Sato et al., 2002, Haenschel et al., 2005) found that the frontally recorded MMN is more sensitive to probability manipulation than is the auditory-cortex source (recorded from the mastoid with nose reference; see a later section).
When two deviants happen to occur in a row, then the MMN to the second deviant is smaller in amplitude than that to the first deviant (Sams et al., 1984, Müller et al., 2005b).The reduction of MMN amplitude is markedly smaller, if the second of two successive deviants deviates from standards in a different attribute than the first deviant (Müller et al., 2005b, Nousak et al., 1996). As already concluded, the MMN cannot be accounted for by the enhancement of the exogenous N1 even though the MMN usually overlaps, at least partially, the N1 when the magnitude of stimulus change exceeds a certain limit (Tiitinen et al., 1994; for a review, see Näätänen et al., 2005). As already mentioned, MEG recordings indicate that the supratemporal source of the MMN can be separated from the N1 source. These studies will be reviewed later. Moreover, robust MMNs (or analogous slow positive waves; Ruusuvirta et al., 2003, Winkler, Kujala et al., 2003a, Maurer et al., 2003a, Maurer et al., 2003b) to various kinds of auditory change can be recorded even in newborns in whom no well-defined N1-type of response is elicited (Alho et al., 1990, Cheour et al., 2002a, Cheour et al., 2002b, Cheour et al., 2002c, Pang and Taylor, 2000). In addition, almost normal-size MMNs to a change in a complex spectrotemporal stimulus, reflecting the effect of prior discrimination training, were present 3 days later in REM sleep in which the N1 was almost completely abolished (Atienza and Cantero, 2001). Moreover, drug effects on the N1 and MMN amplitudes can be very different (e.g., Javitt et al., 1996). In addition, certain lesions may eliminate the MMN but leave the N1 intact (e.g., Alho et al., 1994b). Also, subjects can be trained to perform an initially very difficult discrimination, which is accompanied by the emergence and growth of the MMN with no corresponding effect on the N1 (Atienza et al., 2002b, Näätänen et al., 1993b). When the sequence of standard and deviant sounds is attended, then the MMN is usually elicited quite similarly as when the subject’s attention is directed elsewhere (even though under some conditions with highly focused attention elsewhere, its amplitude may, as will be discussed later, be somewhat attenuated). However, when a sound stream is attended, then the MMN elicited by deviants in this stream is at least partially overlapped by the N2b (Näätänen et al., 1982; for a review, see Näätänen and Gaillard, 1983), with a scalp distribution somewhat posterior to that of the MMN (Aulanko et al., 1993). Furthermore, unlike the MMN, which usually shows a polarity reversal when recorded from mastoid electrodes with nose reference, the N2b shows no such polarity reversal. Hence, the mastoid recordings can provide an estimate of the supratemporal component of the MMN without N2b contamination. The processing negativity (PN) elicited by an attended stimulus stream in the presence of a concurrent irrelevant stimulus stream (Näätänen et al., 1978, Alho et al., 1987, Näätänen, 1988, Näätänen, 1990; see also Hillyard et al., 1973, Hansen and Hillyard, 1983; for an MEG equivalent of the PN, see Hari et al., 1989b) may also overlap the MMN in response to deviants in the attended stimulus stream. The PN is, however, cancelled in the difference waves obtained by subtracting the ERP to standards from that to deviants within the attended channel (Alho et al., 1987). [Hansen and Hillyard’s (1983) “Nd” refers to the PN difference between ERPs to attended and unattended stimulus streams; see Alho et al., 1987.] The scalp-recorded MMN has its largest amplitude over the fronto-central scalp areas. The modeling of the generator sources of the MMN with equivalent current dipoles (ECD) suggests that the fronto-centrally predominant scalp distribution of the MMN is mainly explained by the sum of the activity bilaterally generated in the supratemporal cortices (Giard et al., 1995, Rinne et al., 1999b, Scherg et al., 1989, Jemel et al., 2002). This interpretation is supported by MMNm recordings (Hari et al., 1984, Levänen et al., 1996, Alho et al., 1998a, Alho et al., 1998b, Sams et al., 1991b, Csépe et al., 1992) which show signal maxima over the bilateral supratemporal cortices. Moreover, intracranial MMN recordings in the mouse (Umbricht et al., 2005), guinea pig (Kraus et al., 1994a, Kraus et al., 1994b, King et al., 1995), cat (Csépe et al., 1987, Csépe et al., 1988, Csépe et al., 1989, Csépe, 1995, Pincze et al., 2001, Pincze et al., 2002), rat (Ruusuvirta et al., 1998, Astikainen et al., 2006; see, however, Eriksson and Villa, 2005, Lazar and Metherate, 2003), rabbit (Astikainen et al., 2000), monkey (Javitt et al., 1992, Javitt et al., 1996), and humans (Halgren et al., 1995, Halgren et al., 1998, Baudena et al., 1995, Kropotov et al., 1995, Kropotov et al., 2000, Liasis et al., 1999, Liasis et al., 2000a, Liasis et al., 2001, Rosburg et al., 2005) indicated MMN generation in the auditory cortex. These results also showed that the MMN generation locus can be separated from those of the N1 and the other afferent responses. For example, in humans, the MMNm to frequency change is generated in the supratemporal cortex 3–10 mm anteriorly to the N1m source (Sams et al., 1991b, Csépe et al., 1992, Hari et al., 1992, Huotilainen et al., 1993, Tiitinen et al., 1993, Levänen et al., 1993, Levänen et al., 1996, Liasis et al., 2000a, Alho et al., 1998a, Alho et al., 1998b, Korzyukov et al., 1999, Rosburg, 2003, Rosburg et al., 2004a; see also Rosburg et al., 2004b). A similar difference was also observed in the source localization of the electrically recorded MMN and N1 (Scherg et al., 1989). Optical recordings (Rinne et al., 1999b), too, show a clear separation between the N1 and MMN generators. In addition, intracranial recordings in humans (Kropotov et al., 1995, Kropotov et al., 2000, Rosburg, 2003) indicate that the MMN to deviant sounds among standard sounds and the enhanced N1 response to infrequent sounds occurring with no intervening standard sounds are generated by different neuronal populations. Kropotov et al. (2000) found that one area of the temporal cortex (Area, 22) gave a differential response to deviants (1300-Hz tone) among standards (1000-Hz tone) in the MMN latency range, but did not respond differentially to these tones when each of them was presented alone in a sequence, and did not respond differentially to the 1000-Hz standard tone when it was (alone) presented at a slow (deviant-stimulus) rate or at a fast (standard-stimulus) rate. In contrast, frequency-dependent responses were recorded from Area 41 and responses to rarity per se (i.e., a larger response to deviants alone at their typical long intervals than the response to these stimuli alone at short intervals) from Area 42 (cf. Ulanovsky et al., 2003). Hence, the existence of genuine change-dependent responses could be verified and their cortical origin separated from that of the cortical reception of the afferent input that gives rise to the frequency- and rate-specific cortical afferent responses such as the N1 (N1a; see Näätänen and Picton, 1987). For supporting evidence, see Liasis et al., 1999, Liasis et al., 2000a, Liasis et al., 2000b. Intracranial animal data also support the separability of the MMN from the afferent responses. On the basis of their cat recordings, Pincze et al. (2001) concluded that the MMN was generated in the rostroventral part of the secondary auditory cortex, clearly separated from the P1 and N1 sources. Moreover, Javitt et al. (1996), in the monkey, found that an NMDA-receptor antagonist MK-801 eliminated the MMN kinds of responses to frequency and intensity deviants but left the afferent responses intact. Furthermore, studies using the fMRI (Celsis et al., 1999, Opitz et al., 1999, Opitz et al., 2002, Opitz et al., 2005, Wible et al., 2001, Mathiak et al., 2002, Liebenthal et al., 2003, Schall et al., 2003, Downar et al., 2000, Doeller et al., 2003, Kircher et al., 2004, Molholm et al., 2005, Sabri et al., 2004, Sevostianov et al., 2002, Rinne et al., 2005), PET (Tervaniemi et al., 2000a, Dittmann-Balcar et al., 2001, Müller et al., 2002), and event-related optical signals (EROS) (Rinne et al., 1999b) also suggested MMN generation in the auditory cortex. In addition, Tse et al.’s (2006) very recent optical recordings of brain activity associated with preattentive changes in to-be-ignored sounds are consistent with this result. Moreover, the MMN was attenuated in amplitude in patients with brain lesions involving the auditory cortex (Aaltonen et al., 1993; Alain et al., 1998, Ilvonen et al., 2001, Ilvonen et al., 2003). Importantly, there is evidence indicating that at least partially different neural populations in the auditory cortex are activated by different types of auditory change. This was already suggested by Paavilainen et al. (1991) who found different polarity-reversal ratios for the frequency, duration, and intensity MMNs. Subsequently, studies using dipole modeling of the MMN and MMNm sources reported differences in the range of a few millimeters in location and/or differences in orientation between the sources of the MMN responses to intensity, frequency, ISI, or duration changes (Rosburg, 2003, Frodl-Bauch et al., 1997, Giard et al., 1995, Levänen et al., 1993, Levänen et al., 1996; see also Deouell and Bentin, 1998, Deouell et al., 1998, Doeller et al., 2003). Different, attribute-specific sources are also supported by data (e.g., Nousak et al., 1996) showing that the MMN to the second of two consecutive deviants is not attenuated when the two consecutive deviants differ from the standard in different attributes. Furthermore, a recent fMRI study (Molholm et al., 2005) also found that frequency and duration changes activate different areas both in the supratemporal and frontal cortices. Moreover, unlike MMNs to changes in non-phonetic sounds, MMNs to phoneme changes were elicited with a larger amplitude in the auditory cortex of the left hemisphere than in that of the right hemisphere (Näätänen et al., 1997, Alho et al., 1998a, Shestakova et al., 2002b, Tervaniemi et al., 1999, Tervaniemi et al., 2000a, Rinne et al., 1999a). In addition, Alho et al. (1996) found that the MMN scalp distributions for changes in simple and complex sounds differ from each other in the right-hemisphere temporal cortex. (The quality of the left-hemispheric data did not permit similar comparisons.) See also Alain et al., 1999a, Alain et al., 1999b! There is also some evidence for the tonotopical organization of the MMNm generation to frequency change of a pure tone (Tiitinen et al., 1993). The afore-reviewed results suggest that the MMN might be used to probe the functional sensory-memory organization of the auditory cortex (see also Alain et al., 1998). However, as evidenced by some studies reporting negative findings (i.e., no difference between the sources of different MMNs; e.g., Sams et al., 1991b), the mapping of the different MMN sources in auditory cortex has proven to be rather difficult. This might be partially due to individual differences in the organization of the auditory fields in the supratemporal cortex. In addition to the bilateral supratemporal cortices, other cortical areas are also involved in MMN generation. A frontal-lobe involvement in MMN generation was already proposed on the basis of their only four-channel scalp-potential recordings by Näätänen et al. (1978). This suggestion (see also Näätänen and Michie, 1979) was supported by later analyses of the MMN scalp-potential distribution (scalp current density analysis, SCD), which indicated an additional MMN source in the frontal lobes (Deouell et al., 1998, Giard et al., 1990; Yago et al., 2001a, Yago et al., 2001b). Frontal MMN sources were also suggested by studies using source-current modeling (Rinne et al., 2000, Waberski et al., 2001) and multi-dipole modeling (Jemel et al., 2002) techniques. Furthermore, frontal MMN sources were also supported by intracranial ERP (Baudena et al., 1995, Liasis et al., 2001, Rosburg et al., 2005), PET (Dittmann-Balcar et al., 2001, Müller et al., 2002), and fMRI recordings (Celsis et al., 1999, Opitz et al., 2002, Doeller et al., 2003, Schall et al., 2003, Molholm et al., 2005, Rinne et al., 2005) as well as by developmental data (Gomot et al., 2000). The functional role of the frontal lobes in the processing of infrequent sound changes and in MMN generation remains poorly understood, however (see also Restuccia et al., 2005). Some animal studies (Kraus et al., 1994a, Kraus et al., 1994b, Csépe et al., 1989; Ruusuvirta et al., 1995, Astikainen et al., 2005) also indicated responses to infrequent sound changes in the thalamus and hippocampus. It is not clear, however, whether these responses are genuinely related to sound-change processing or are caused by the rarity of the infrequent sound, like the enhanced N1 to infrequent sounds delivered with no intervening standard sounds. The lack of the effects of hippocampal lesions on the MMN in humans (Alain et al., 1989) supports the latter alternative. In contrast, thalamic lesions attenuated the MMN amplitude (Mäkelä et al., 1998), suggesting the involvement of the thalamus in the generation of genuine deviance-detection activity. In addition, a right parietal-lobe contribution to auditory change detection was suggested by several studies (Kasai et al., 1999, Levänen et al., 1996; Lavikainen et al., 1995, Schall et al., 2003, Molholm et al., 2005). It is possible that the parietal activation, which seems to occur clearly later than the temporal one, is in fact related to other processes than the MMN, such as the generation of the P3a, however. In experimental conditions with several frequent stimuli, MMN elicitation may show modularity. This is the case when stimuli form separate perceptual streams (Bregman, 1990), e.g., when two concurrent sound sequences are dichotically presented at a rapid rate. Hence, frequency or other deviants in each stream elicit an MMN relative to the standard of the same ear only, there being no, or only very little, across-ear “cross-talk” (Praamstra and Stegeman, 1992, Ritter et al., 2000, McKenzie and Barry, 2006). This means that there can be two or several parallel memory traces with separate MMN elicitation in the same stimulus block. Moreover, it is also possible to create three parallel streams with separate MMN elicitation. Nager et al. (2003b) produced, in different conditions, either, one, two, or three auditory streams defined by spatial position (different loudspeakers) and frequency. Nevertheless, an MMN was elicited by deviants, shorter-duration tones with a slightly higher pitch than that of the other tones of the respective stream. This MMN was, however, of a lower amplitude in the 3-streams condition than those in the 1-stream and 2-streams conditions. (Control experiments ruled out the possibility that this attenuation was due to differences in the stimulus rate.) This effect was interpreted as reflecting the capacity limits of auditory sensory memory, resulting in less accurate traces of each stream as the number of the concurrent stimulus streams is increased. Separate streams can also be created within the same locus of sound origin by introducing a major frequency difference between the two concurrent stimulus sequences, with each being presented at a relatively short ISI (Sussman et al., 1999, Yabe et al., 2001a, Yabe et al., 2001b, Winkler et al., 1992; Shinozaki et al., 2000). See also Winkler et al., 1996a, Ritter et al., 1995, Gomes et al., 1997, Fujioka et al., 2004, and Brattico et al., 2002a, Brattico et al., 2002b. Moreover, a moving sound source (the consecutive steps of a walking person) also forms a sound stream, a deviation in which elicits an MMN even in the presence of continuous loud environmental noise (Winkler et al., 2003c). The studies reviewed in the afore-going (see also Müller et al., 2005b) convincingly demonstrated that stream segregation precedes, and provides a prerequisite for, MMN elicitation (and thus, apparently, also for selective attention in audition; see Näätänen, 1990). Hence, the MMN is closely associated with the way the central auditory system organizes the incoming sounds: the sound organization determines the regularity on which MMN elicitation is based (see also Sussman et al., 1998a, Winkler et al., 2001, Alain et al., 2001, Alain et al., 2002 for reviews, see Alain et al., 1994; Näätänen et al., 2001, Näätänen and Winkler, 1999). These characteristics of the MMN, together with the relative attention independence, make it ideal for testing whether a certain phenomenon of auditory perception depends on attention. Such an approach has been applied to the octave illusion (Ross et al., 1996), continuity illusion (Micheyl et al., 2003), and the illusory conjunction of different stimulus features (Takegata et al., 2005a, Winkler et al., 2005).3.1. Separation of the MMN from the other components
3.2. MMN generators
3.3. Perceptual streaming and stream segregation as indexed by the MMN
4. Perceptual integration in audition as reflected by the MMN
4.1. Feature integration
Consequently, the traces involved in MMN elicitation seem to reflect feature-integrated sensory information underlying unitary auditory percepts (for a review, see Näätänen and Winkler, 1999). This was also shown by Gomes et al. (1997) who obtained an MMN by infrequently presenting a stimulus produced by conjugating features from two separate frequent stimuli. Subjects were presented with series of 4 different tones. Three of the tones (standards) were each delivered at a 30% probability, each differing from the others in both frequency and intensity. The deviant tone (probability of 10%) matched the frequency of one standard and the intensity of another standard. Since each feature of the deviant tone was also present in one of the standards, the MMN elicited by the deviant stimulus could be due to its infrequent feature conjunction only. (See also Nousak et al., 1996, Deacon et al., 1998.)
Such feature-integrated representations in audition are formed without focal attention to stimuli. Winkler et al. (2005) found that MMNs to rare combinations of acoustic features were quite similar irrespective of the modality and direction of focal attention. This result challenges the extension to the auditory modality of Treisman, 1988, Treisman and Gelade, 1980, Treisman and Sato, 1990 influential feature-integration theory which holds, based on visual studies, that the correct conjoining of features needs focal attention. However, the afore-reviewed auditory MMN studies on feature integration used sequentially presented sounds only, whereas the visual studies on feature integration used parallel presentation. Recently, Takegata et al. (2005a), however, found that the MMN responses to rare conjunctions of auditory features did not depend on attention even when an array of spatially distributed concurrent sounds, an analog to the stimulus display in visual studies, was used.
The MMN has also been used to test the attentional dependence of the illusory conjunction of features in audition (Takegata et al., 2005a; Winkler et al., 2005).
Regularities at different levels (such as those involving acoustic features, conjunctions of features, and sequential patterns of sounds) appear to be represented in parallel. Takegata et al. (1999) found the parallel elicitation of MMNs to changes in a single acoustic feature and to those in the conjunction of features. This result was supported by their MEG data (Takegata et al., 2001a, Takegata et al., 2001b, Takegata et al., 2001c) showing that MMNm elicitation for two simple acoustic features (frequency and location) and that for the conjunction of these features activated at least partially distinct neural populations. Consistent with this, Alain et al., 1999a, Alain et al., 1999b, Alho et al., 1996 found that different neuronal populations appeared to be involved in the MMN generation for a simple acoustic feature (frequency) and in that for a sequential pattern formed by tones of different frequencies.
Thus, memory traces underlying MMN elicitation range from the level of the static acoustic features to that of the conjunction of these features into unitary sounds and to higher-order spatiotemporal patterns. Näätänen and Winkler (1999) distinguished two stages, or levels, of output in central auditory processing: (a) sensory feature traces that correspond to the separate features of the stimulus; and (b) the unitary stimulus representation of the full auditory event. Depending on the structure and parameters of the stimulus sequence, an MMN elicited by a certain acoustic change can reflect any, or even the combination, of memory traces at different levels (Ritter et al., 1995; Schröger, 1997).
4.2. Stimulus grouping
When sounds are presented at a fast rate, stimulus grouping on the basis of the temporal or spatial proximity or of some repetitive pattern of stimulation may occur. Scherg et al. (1989), using a stimulus-onset-asynchrony (SOA) of 0.9 s, found no difference in the MMN amplitude for a frequency change between regular (deviant, D, every fifth stimulus) and randomized stimulus delivery (D occurring at p = .20). However, Sussman et al. (1998b), replicating the Scherg et al. (1989) result with an SOA of 1.3 s, found that this frequency MMN in the regular condition disappeared when the SOA was made very short (100 ms). The authors concluded that the fast stimulus rate enabled the central auditory system to group all 5 stimuli (SSSSD, with S denoting the standard) together as a unit which effectively formed the regular, standard, stimulus event. That is, with this short ISI, several of these 5-stimulus sequences could be simultaneously represented in auditory sensory memory. Therefore they were represented as the standard event in this memory, i.e., frequency deviants, in fact, formed a part of the 5-tones standard. [A control block showed that an MMN was elicited when the short-SOA (100 ms) stimulus block was presented with a randomized stimulus order]. With the 1.3 s SOA, the stimulus rate may have been too slow. See also Alain et al., 1994, Alain et al., 1999a, Alain et al., 1999b and Alain and Izenberg (2003).
Recently, Sussman (2005) demonstrated that in the presence of multiple stimulus streams, the grouping and integration processes to perceptual units, as judged from the MMN data, take place modularly within the already formed streams. This result implies, for example, that speech intelligibility in the presence of two or several speakers is supported by automatic within-channel grouping and, further, that such integration processes distinguish speech units separately within each stimulus stream (see later). (See also Fujioka et al., 2005.) For further MMN studies on the temporal grouping of auditory stimuli, see Müller and Schröger, 2007, Müller et al., 2005a, Müller et al., 2005b, Takegata et al., 2005b.
4.3. Audio–visual integration
The MMN can also be used to probe the neural processes underlying the auditory–visual integration, in particular, whether the activity in the auditory cortex is modulated by visual stimuli. Sams et al. (1991a), in a pioneering study, compared the MEG responses to rare, incongruent audio–visual stimuli (acoustic /pa/ simultaneously with visual /ka/), perceived as a different syllable (/ta/; the McGurk effect; McGurk and MacDonald, 1976), with those to congruent, frequent stimuli (acoustic /pa/ paired with visual /pa/). Even though the acoustic parts of the stimuli were identical, the rare stimuli nevertheless elicited an MMNm with a clear activation in the auditory cortex. (see also Colin et al., 2002a, Colin et al., 2004a, Colin et al., 2004b, Möttönen et al., 2002, Ullsperger et al., 2006; see, however, Besle et al., 2005). In addition, Colin et al., 2002b, Stekelenburg et al., 2004 found that an MMN accompanied an illusory shift in sound location (the ventriloquist illusion). For possible neural mechanisms of multisensory convergence during the early cortical processing, see Foxe and Schroeder, 2005, Besle et al., 2005, Molholm et al., 2002, Giard and Peronnet, 1999, Bernstein et al., 2002.
4.4. Temporal integration
Näätänen and Winkler (1999) proposed that the central sound representation (CSR) is formed when the outcomes of the different parallel feature-specific processes cumulate on the neural mechanisms of auditory sensory memory. The neural sensory-memory trace then emerging (with this phase underlying perception) contains the highly stimulus-specific feature-integrated sensory information that is present in perception and sensory memory. This integration process uses, presumably, a sliding temporal window of some 150–200 ms in duration, i.e., the temporal window of integration (TWI; Näätänen, 1990). The emerging central sound representation, the CSR, usually enters conscious perception but may also remain subjectively silent (Näätänen, 1992). During the TWI, acoustic stimulation from the same source or channel (i.e., of similar acoustic parameters and approximately the same spatial origin; see Shinozaki et al., 2003) is integrated into a unitary auditory percept.
The estimate of the TWI duration is based on both behavioural and MMN data. Behavioural studies showed that loudness summation for brief sounds continues up to durations of about 200 ms (Moore, 1989, Scharf and Houtsma, 1986; Zwicker and Fastl, 1990). Furthermore, backward recognition-masking studies (Cowan, 1984, Foyle and Watson, 1984, Hawkins and Presson, 1977, Hawkins and Presson, 1986, Massaro, 1970) found that when the mask followed the onset of the brief test stimulus, to be identified by the subject, with an interval shorter than 150–200 ms, then the stimulus features were incompletely perceived. Hence, it appeared that about 150–200 ms from stimulus onset is needed for the completion of the trace development, and thus for a fully elaborated percept to emerge. For supporting MMN data from the backward-masking paradigm, see Winkler and Näätänen, 1992, Winkler and Näätänen, 1994 and Winkler et al. (1993).
Furthermore, an infrequent stimulus omission elicits an MMN only when the constant SOA is shorter than 150 ms (Yabe et al., 1997, Yabe et al., 1998; see also Tervaniemi et al., 1994b). Yabe et al. (1997) suggested that auditory input is processed in circa 150–170-ms temporal segments (the TWI); therefore stimulus omission from this time segment initiated by the preceding stimulus elicited an MMN, whereas stimulus omission occurring thereafter did not (i.e., with SOAs >150 ms). Corroborating evidence was provided by Yabe et al., 2001a, Yabe et al., 2001b, Yabe et al., 2005a, Yabe et al., 2005b, Wang et al., 2005a.
Schröger (1997) developed an ingenious way to estimate the duration of the trace-formation process. They presented a location deviant as the last stimulus of a train of 4 or 11 stimuli of 30 ms in duration. When the silent ISI between the consecutive stimuli was 10 msec, then no MMN was elicited by the last stimulus of a train of 4 stimuli, whereas it was elicited when the ISI was 170 ms. Furthermore, the MMN was elicited by the last stimulus in the 11-stimulus trains irrespective of the ISI. Thus, the time needed for trace formation, i.e., the TWI duration, seems to be longer than 120 ms but shorter than 400 ms.
The TWI may also be crucial for speech perception and musical experience. Both depend on the simultaneous psychological presence of auditory stimulation from a time window of some short duration rather than from any given moment. Thus, auditory perception does not correspond to the immediately present acoustic reality (corrected with the delay caused by auditory processing) but rather to the outcome of temporal integration over the immediate past of some 150–200 ms (the TWI). Näätänen (1990) proposed that the continuously sliding temporal window of integration actually provides this temporally stretched psychological presence. According to him, the TWI may considerably expand in time “the ‘psychological presence’ in audition relative to the timeless ‘cutting edge’ of physical presence that continuously turns the future into the past” (p. 275).
The TWI was also supported by Winkler et al. (1998) whose standard stimuli started as a sinusoidal tone of a single frequency but terminated as a frequency glide of 50 ms in duration. The deviant differed from the standard in two features: stimulus intensity and the direction of the frequency glide. The deviant elicited two temporally separate MMNs when the sinusoidal part of the complex sound was 250 ms in duration, that is, when the glide (the second deviant feature) started 250 ms after the onset of the first (i.e., intensity) deviance in the deviant sound. However, only a single MMN (corresponding in latency to that elicited by intensity deviance) was elicited by the deviant sound when the pure-tone part of the complex sound was 150 ms, i.e., the onsets of the two deviations in the deviant sound were separated by 150 ms only. This result suggests that two temporally separate deviations from the same standard are treated as a single deviant event if these two deviations occur within the same TWI.
Corroborating evidence using two other sound features, viz., tone frequency and duration, was provided by Czigler and Winkler, 1996, Winkler and Czigler, 1998. Moreover, Sussman et al. (1999) obtained compatible results when the two deviations (one in frequency, the other in intensity) occurred in two separate consecutive short tones.
On the basis of these and other evidence, Näätänen and Winkler (1999) concluded that the sensory-memory trace formation is a fast, automatic process that is completed by about 200 ms from stimulus onset (the TWI) and that underlies (provides the specific sensory-informational contents for) the transient percept of the sound. In this process, both parallel (feature integration using the outputs from the different feature-analyzer systems) and sequential (temporal) integration of sensory information occurs. The authors, however, stressed that although this temporal-integration process sometimes results in information loss, as in detection masking and recognition masking, this integration usually is of constructive nature, structuring or segmenting the auditory perceptual world (Bregman, 1990). See also Sussman et al., 2002a, Sussman et al., 2002b, Sussman, 2005. “It is expected that a smooth (frequency) transition would prevent the backward masking of recognition of segments within the sound” (Cowan, 1984, p. 359). Such transitions form an essential element in natural sounds, such as speech and music. Therefore, according to Näätänen (1995), rather than condensing the time dimension, temporal integration binds together temporally closely spaced events at the perceptual level (e.g., the integration of two closely spaced tones to form a single perceptual event; Csépe et al., 1997, Loveless et al., 1994, Loveless et al., 1996, Tervaniemi et al., 1994b; Winkler and Näätänen, 1994).
Moreover, Yabe’s (2002) and Yabe et al., 2005a, Yabe et al., 2001a, Yabe et al., 2001b, Yabe et al., 2005b, Yabe et al., 1998 recent MMNm studies of the TWI in a significant way furthered our understanding of its nature and properties. In addition, related studies were conducted by Sussman et al., 2002a, Sussman et al., 2002b, Sussman and Winkler, 2001, Sussman, 2005. Furthermore, Wang et al. (2005a) found that the TWI duration, as indexed by the MMN, for young children (5–8 years) is almost twice that in adults but is gradually shortened with maturation. Interestingly, Rüsseler et al. (2001), using the Yabe et al. (1997) stimulus-omission paradigm, obtained MMN results suggesting that musicians, too, have a prolonged TWI duration, one longer than that of non-musicians. One might wonder whether the age-related decrease in the TWI duration is slower in musicians than in others.
Furthermore, Shinozaki et al. (2003), recording the MMNm to infrequent omissions of the second tone in repetitive tone pairs composed of two closely spaced tones of different frequencies, extended the concept of the TWI even to involve the spectral proximity of stimuli. Their spectro-temporal window of integration (STWI) only integrated those stimuli falling on the same TWI that also were rather similar in frequency with each other (see also Yabe et al., 2001b), however accepting larger differences in the early than late phase of the TWI. The authors concluded that this study provides “the first neurophysiological evidence of the two-dimensional (spectrotemporal) window of integration existing in the human brain. Two stimuli presented in close succession in the time-by-frequency surface might be presented in the auditory system as a unitary integrated event. This auditory spectrotemporal integration should play an indispensable role for the neural processing of complex signal sequence such as vocalizations, speech and music” (Shinozaki et al., 2003, p. 570).
5. Automaticity of MMN elicitation
As already mentioned, the MMN generation is an automatic brain process in the sense that its occurrence does not depend on attention (Näätänen et al., 1978, Näätänen and Michie, 1979, Alho et al., 1989, Alho et al., 1994a, Alain et al., 1994; see also Muller-Gass et al., 2005). Hence, the MMN is elicited even when attention is strongly focused on a concurrent auditory stimulus stream. Under such conditions, the MMN amplitude may be somewhat attenuated, however (see Woldorff et al., 1991, Woldorff et al., 1998, Alain and Izenberg, 2003, Alain and Woods, 1994, Alain and Woods, 1997; Näätänen et al., 1993a, Dittmann-Balcar et al., 1999, Arnott and Alain, 2002, Trejo et al., 1995, Muller-Gass et al., 2005, Woods et al., 1992, Woods et al., 1994, Näätänen et al., 1993a, Kathmann et al., 1999, Oades and Dittman-Balcar, 1995, Alho et al., 1992, Otten et al., 2000). Some of these studies (e.g., Arnott and Alain, 2002, Woldorff et al., 1991) even claimed that the MMN was totally abolished by the very strong focusing of attention on another auditory input stream, however, but judging from the data presented, a small MMN residual may nevertheless have remained (for a discussion, see Näätänen, 1991; see also Alain and Izenberg, 2003). There are also a number of studies in which attention to another auditory stimulus stream had no influence on the MMN amplitude (e.g., Alho et al., 1989, Alho et al., 1994a, Sussman et al., 2003b, Näätänen et al., 1978, Näätänen et al., 1982, Kaukoranta et al., 1989, Lounasmaa et al., 1989, Paavilainen et al., 1993b).
It is also possible that attention effects on the MMN amplitude depend on the magnitude of stimulus change, with MMNs to smaller changes being more susceptible to attentional influences than those to larger changes (Müller et al., 2002), and on the attribute of stimulus deviation (Näätänen, 1991, Näätänen et al., 1993a, Muller-Gass et al., 2005). For instance, in Woldorff et al.’s (1991) study, the intensity MMN was much more sensitive to the withdrawal of focused attention than was the frequency MMN (for corroborating data, see Näätänen et al., 1993a). In addition, it appears that the (right-hemisphere) frontal source of the MMN is more sensitive to attentional effects than the temporal source (Restuccia et al., 2005). Furthermore, Näätänen (1991) proposed a division of neurons involved in the MMN process into (1) computational and (2) amplifying ones, suggesting that it is the latter neurons that might be modulated by attention. He also concluded that, in general, the degree of attention independence of the MMN is well sufficient to justify its use as an objective measure of central auditory processing.
When comparing deviance-related difference waves between the attended and unattended stimulus streams, there is the problem of component overlap in the attended channel in which deviants elicit the N2b (Näätänen et al., 1982), too (see Näätänen, 1991), and may also elicit the processing negativity when the temporal probability of the deviant exceeds a certain limit (Näätänen, 1990, Näätänen, 1992). For instance, in Woldorff et al.’s (1991) study, the presence of the N2b is suggested by the scalp distribution of the attentional enhancement. The considerably larger Cz than Fz amplitudes of the difference waves (e.g., their Fig. 4) seem, in particular, to indicate the presence of the N2b component which is generally larger in amplitude centrally than frontally, whereas the MMN is usually larger frontally. Fig. 4. A model illustrating attention and automaticity in auditory processing. For explanation, see text! Adapted, with permission, from Näätänen (1990).
Importantly, Ritter et al. (1999) proposed that the MMN source itself might well be attention-independent but nevertheless generates an attenuated MMN because of attentionally reduced inflow in the channel (Woldorff et al., 1987, Woldorff et al., 1991, Woldorff and Hillyard, 1991). In this case, one could predict a constant MMN/N1 amplitude ratio (with the N1 indexing the magnitude of that inflow) rather than a constant MMN amplitude per se across the different attention conditions.
In addition, Sussman et al. (2003c) suggested a biased-competition explanation for these findings: changes occurring in the same feature in two auditory channels would compete for being processed by the MMN system. When the change in one channel is designated as the target in an active discrimination task, then the competition for the feature-specific MMN resource would become biased, that is, changes in the target would be given priority in accessing the MMN system. This would cause the MMN to be attenuated, or even eliminated, in the unattended channel for the target feature. However, as suggested by Sussman et al.’s (2003c) data, the competition is only biased for the target feature, not for other auditory features (i.e., there is no general MMN suppression of the unattended channel).
Several studies also manipulated the visual task load but usually found no attentional modulation of the MMN amplitude (Otten et al., 2000, Alho et al., 1992, Alho et al., 1994a, Dittmann-Balcar et al., 1999, Dyson et al., 2005, Kathmann et al., 1999, Müller et al., 2002, Muller-Gass et al., 2005, Muller-Gass et al., 2006, Harmony et al., 2000, Sussman et al., 2005, Winkler et al., 2005, Takegata et al., 2005a; see, however, Kramer et al., 1995, Yucel et al., 2005a, Yucel et al., 2005b, Woods et al., 1992). Even opposite results have been reported: Zhang et al. (2006) found that with an increasing visual attentional load, the MMN amplitude for a frequency change in irrelevant background stimulation became larger (whereas the subsequent P3a response became smaller, indicating decreased involuntary attention switching with increased visual task load).
Further, attention may affect the MMN indirectly by affecting the regularity maintained in auditory sensory memory. Sussman et al. (2002a) found that the MMN was elicited by a frequency change in a repetitive tone (tone 1) regularly occurring in every fifth tone (tone 2) both when subjects were instructed to attend to the pitch of the stimuli (to detect an occasional, third, tone of still another frequency, i.e., tone 3) and when they ignored stimuli. When subjects were informed about the overall structure of the stimulus sequence, and instructed to respond to pattern violations, then no MMN was elicited by frequency deviants. This suggests that in the Attend-pattern condition, Tone 2 was processed as a member of the standard, which was represented as a repeating tone pattern (i.e., 11112). Thus, the data provide evidence suggesting that top-down effects occur at the level of stimulus encoding, affecting the sensory information used in the MMN process (see also Sussman and Gumenyuk, 2005, Sussman and Steinschneider, 2006, Sussman et al., 1998a, Sussman et al., 1998b, Sussman et al., 2002b, Sussman et al., 2003a, Sussman et al., 2003b). Additionally, the full correspondence found between the perceptual sound organization (assessed by the N2b data and the subjective reports) and the sound organization inferred from the MMN results is consistent with the hypothesis that the sound representations involved in the MMN-generating process also underlie sound perception (Näätänen and Winkler, 1999). Similar effects were also obtained when subjects selectively attended to one of the concurrent auditory streams (Sussman et al., 2003b, 2005).
As for the selective-attention effects on longer-latency ERP components, they are robust in that during strong attentional focus elsewhere, all ERP components subsequent to the MMN in response to deviants in the unattended stream are strongly attenuated or totally abolished such as the P3a and the subsequent negativities (Otten et al., 2000). In these studies, the MMN-generator activation apparently did not succeed in triggering attention switch and further processing in the unattended channel (see also Näätänen, 1992, Berti et al., 2004). Consistent with this, the afore-reviewed Zhang et al. (2006) study (for corroborating results, see Duncan and Keye, 1987, Harmony et al., 2000; Yucel et al., 2005a, Yucel et al., 2005b) showed that the P3a, an index of the occurrence of an attention switch (Squires et al., 1975, Escera et al., 1998, Knight, 1996), is elicited by unattended-stream deviants when the attention-demanding task performed by the subject is easy but is not elicited when it is difficult. This suggests that involuntary attention switch has an elevated threshold when the task is more difficult.
Furthermore, the automaticity of the MMN is strongly supported by, for example, MMN elicitation even in comatose patients [e.g., in Fischer et al., 2004, Fischer et al., 2006 patients, the Glascow Coma Scale score <8], which may occur when widely deviant stimuli are presented to patients whose consciousness will recover later (Kane et al., 1993, Kane et al., 1996; Fischer et al., 1999, Fischer et al., 2004, Fischer et al., 2006, Luauté et al., 2005, Morlet et al., 2000). These data suggest that the MMN can be used as a tool in coma-outcome prediction. Moreover, the MMN can be elicited even in anaesthesia (Csépe et al., 1989, Koelsch et al., 2006, Heinke et al., 2004, Heinke and Koelsch, 2005, Yppärilä et al., 2002), and is also elicited at certain sleep stages in adults (Sallinen et al., 1994, Sallinen et al., 1996, Sallinen and Lyytinen, 1997, Campbell and Colrain, 2002, Campbell et al., 1988, Campbell et al., 1991, Atienza et al., 1997, Atienza et al., 2000, Atienza et al., 2001, Atienza et al., 2002a; Atienza and Cantero, 2001, Nielsen-Bohlman et al., 1991, Nashida et al., 2000, Nittono et al., 2001) and, irrespective of the sleep stage, in newborns (Cheour et al., 2000, Ceponiene et al., 2002; see also Friederici et al., 2002).
Consistent with this, the MMN is usually not affected by the predictability of deviant stimuli. As already reviewed, Scherg et al. (1989) found that the MMN amplitude was not affected by whether deviants (20%) occurred regularly (every fifth stimulus in a block) or randomly in the stimulus block (the SOA was 1 s) (see also Jankowiak and Berti, 2007). [However, as already mentioned, when Sussman et al. (1998b) shortened the SOA so that the deviant was perceptually grouped with the 4 preceding standards, then no MMN was elicited.] Moreover, the MMN amplitude was not affected by the presentation of a visual stimulus serving as a time signal for the subsequent occurrence of a deviant auditory stimulus (Ritter et al., 1999, Rinne et al., 2001).
6. Involuntary attention switch to auditory change (passive attention)
It is assumed that the activation of an auditory change-detection mechanism reflected by the MMN may also trigger the switching of attention to potentially important events in the unattended auditory environment (Näätänen et al., 1978, Näätänen and Michie, 1979, Giard et al., 1990). This suggestion is supported by numerous studies (Schröger, 1996a, Schröger, 1996b, Alho et al., 1997, Escera et al., 1998, Escera et al., 2000a, Escera et al., 2001, Escera et al., 2003, Schröger and Wolff, 1998a, Schröger and Wolff, 1998b, Wolff and Schröger, 2001a, Wolff and Schröger, 2001b, Schröger et al., 2000, Berti and Schröger, 2001; Roeber et al., 2003a, Roeber et al., 2003b, Berti et al., 2004, Shestakova et al., 2002a, Yago et al., 2001a, Yago et al., 2001b, Jankowiak and Berti, 2007, Rinne et al., 2006). These results indicated that MMN-eliciting sound changes in irrelevant auditory background stimulation distract task performance and, further, that they also elicit a subsequent P3a response thought to be associated with the actual orienting of attention to a deviance in an unattended sound sequence or in some irrelevant feature of attended sounds (see Squires et al., 1975, Ford et al., 1976, Escera et al., 1998, Escera et al., 2001, Shestakova et al., 2002a, Wang et al., 2005b; for reviews, see Friedman et al., 2001, Ranganath and Rainer, 2003). This is also supported by the fact that the MMN may also be followed by autonomic nervous system (ANS) responses associated with the involuntary orienting of attention such as heart-rate deceleration and the skin-conductance response (Lyytinen et al., 1992; see also Sokolov et al., 2002).
For example, Schröger (1994), using a selective dichotic-listening paradigm, found that the RT to an infrequent softer-intensity stimulus in the right ear increased and the hit rate attenuated when this target stimulus was preceded (with a 200-ms lead time) by a frequency deviant in the left ear. In addition, when the frequency deviation was 50 Hz (standard 700 z), the RT increased by 12 ms, and with a deviation of 200 Hz, the RT prolongation was 26 ms. Both frequency deviants elicited MMNs while the wider frequency deviant also elicited N2b-P3a waves. According to Schröger (1994), “this performance decrement was probably due to attentional capture to the to-be-ignord channel triggered by the deviants of this channel.” He further proposed that the data pattern obtained supports the hypothesis that the neural processes generating the MMN may be involved in a mechanism of passive attention switch (pp. 88–89).
Interestingly, the MMN elicited by occasional intensity increments is followed by a distinct P3a, whereas that elicited by equivalent intensity decrements usually is not (Rinne et al., 2006; see also Näätänen, 1992; Fig. 3). Intensity decrements tend to be much less attention-catching auditory events than are intensity increments. This might be due to the fact that intensity increments also activate fresh afferent neurons (resulting in N1-component enhancement), whereas intensity decrements (resulting in N1 attenuation; Näätänen et al., 1989a) appear to activate no, or only a small number of, such neurons.
In general, this attention-switching mechanism even responds to minor changes, with its sensitivity approaching that of the behavioural discrimination in attend conditions. For instance, Berti et al. (2004) found that subjects’ performance in a tone-duration discrimination task deteriorated in almost a half of the trials even by an occasional 1% frequency change in this tone. Importantly, in contrast to the MMN, the P3a and RON (the reorienting negativity; Schröger and Wolff, 1998b) were only elicited in trials with an RT prolongation, i.e., when an involuntary attention switch occurred.
The prefrontal cortex has an important role in controlling the direction of attention (Fuster, 1989, Stuss and Benson, 1986, Stuss and Knight, 2002; Näätänen, 1988, Näätänen, 1990, Näätänen, 1992). Therefore, it was proposed that the frontal MMN activity might signify the call for (cf. Öhman, 1979), or the initiation of, the involuntary orienting of attention to a change in the acoustic environment detected by the preattentive auditory-cortex MMN mechanism (Giard et al., 1990; Näätänen, 1979, Näätänen, 1985, Näätänen, 1988, Näätänen, 1990, Näätänen, 1992, Näätänen et al., 1978; Näätänen and Michie, 1979, Rinne et al., 2000). Consistent with this hypothesis that preconscious auditory-cortex change detection triggers frontal mechanisms of attention switch, the time course of this frontal activation to auditory change is slightly delayed relative to that of the auditory-cortex activation (Rinne et al., 2000, Kwon et al., 2002). Alternatively, it was suggested that, instead of attention switching, the prefrontal activation contributing to the MMN might be related to a contrast-enhancement mechanism which would be activated when the supratemporal system gets into difficulty in discriminating stimuli (Doeller et al., 2003, Opitz et al., 2002; see also the “sensitization negativity” of Näätänen et al., 1982; see also Alho et al., 1994a).
The role of the prefrontal MMN generator in initiating a switch of attention towards an auditory change was also supported by the effects of ethanol on the MMN and performance. Jääskeläinen et al. (1996c) found that the attenuation of the MMN amplitude even by small amounts of ethanol (0.55 g/kg) resulted from the attenuation of the prefrontal rather than that of the supratemporal MMN subcomponent. Moreover, it was observed that such a small amount of ethanol in fact decreased the distracting effect of changes in task-irrelevant auditory stimuli on performance accuracy in a visual forced-choice discrimination task, i.e., improved the performance under such conditions (Jääskeläinen et al., 1996a). Taken together, these findings suggest that even small amounts of ethanol attenuate the prefrontal process generating the frontal MMN subcomponent and initiating an involuntary switching of attention towards deviant sounds in an irrelevant auditory stream (for a review, see Jääskeläinen et al., 1996b). In addition, quite recently, Kähkönen et al. (2005) obtained MMN evidence for serotonic and Kähkönen et al. (2002) for dopaminergic modulation of this involuntary attention-switching response. [See also Simoens et al. (2007) who interpreted their duration-MMN data as suggesting that cortisol interferes with the preattentive mechanism of the MMN response.]
The functioning of this attention-switching mechanism was also studied in the presence of background noise.When presenting standards and deviants to the right ear, Levänen and Sams (1997) found that music presented to either ear abolished the MMNm to deviants whereas white noise did the same only when it was presented to the right ear. Furthermore, behavioural discrimination, studied in a separate condition, yielded an analogous pattern of data. The authors proposed that during music masking, standard stimuli are integrated with the constantly changing features of the masker into integrated events. Furthermore, similar integration, of course, affects, as already maintained by the authors, the neural representation of the deviants. Therefore, according to them, the representations of the standards and deviants become so similar that they do not allow change detection, resulting in the absent or strongly reduced MMNm and in the impaired discrimination performance. (See also Kozou et al., 2005, Mäntysalo and Salmi, 1989.)
The role of the prefrontal MMN generator in a switch of attention to auditory change was also supported by Restuccia et al. (2005) who found that the attentional load of the primary task affected the frontal but not the temporal MMN generators.
An auditory change does not cause attention switch each time the change occurs (e.g., Berti et al., 2004), however; it may remain consciously unperceived. This may be due to the fact that the deviant sound does not differ enough from the stimulus represented by the sensory-memory trace, either because the difference is very small or the neural trace is informationally too diffuse. That is, the representational width of the neural trace for the auditory attribute involved is too large in relation to the magnitude of change (Näätänen and Alho, 1997). Second, the memory trace underlying the previous sounds may already have decayed, so that no automatic comparison process can take place. Third, when attention at the moment of change is intensively focused elsewhere, then the threshold for attention switch may be elevated (Lyytinen et al., 1992, Näätänen, 1992, Harmony et al., 2000, Restuccia et al., 2005). Fourth, the excitability of the frontal MMN generator may be temporally decreased, for example, by alcohol (Jääskeläinen et al., 1996c). Fifth, when the subject knows in advance when a deviant stimulus in a block will occur, then no attention switch (as reflected by the absence of behavioural effects and the P3a) takes place even though the MMN is normally elicited (Sussman et al., 2003b).
For a model of attention and automaticity in the auditory modality, see Näätänen, 1990, Näätänen, 1992. This model (Fig. 4) postulates a fully automatic stimulus analysis (by the Permanent Feature-Detector and Transient-Detector systems) and a brief storing of this information into a sensory-memory trace (in the neural subtrate of Sensory Memory). The phase of the formation of this trace on the basis of the input from different feature detectors underlies the emergence of sound percept. Furthermore, on this model, there are two parallel routes to attention switch: (1) N1 neurons triggered by sound onset (causing attention switch to the occurrence of the sound); (2) MMN neurons triggered by auditory change, i.e., by a new input to the neural substrate of sensory memory, not corresponding to the stimulation already represented by this memory system. Further, this memory-trace formation initiated by the new stimulus in the auditory cortex triggers the frontal-cortex mechanisms of attention switch to stimulus change (the auditory- and frontal-cortex MMN subcomponents, respectively). In addition, the precise sensory information maintained in the neural mechanism of sensory memory is used to develop the attentional trace when selective attention is to be directed to the corresponding stimulus stream, a temporary selection mechanism for the to-be-attended input depending on continuous maintenance (Näätänen, 1982, Näätänen, 1990). Hence, on this model, the sensory-memory information involved in MMN elicitation is used in tuning the selective-attention mechanism to select just a designated kind of stimulus among the concurrent ones, e.g., a tone of 1000 Hz among tones of 1050 Hz. Consequently, to set up and maintain this highly precise voluntary representation, the executive mechanism must use the corresponding stimulus representation of sensory memory. The assumed dependence of selective attention on fresh sensory-memory information is shown, for example, by the fact that one needs to receive a few exemplars of the to-be-attended stimulus before stimulus selection can occur, i.e., the selective sensory state (Näätänen, 1975, Näätänen, 1982, Näätänen, 1990) can be developed (and the PN be generated) (see Hansen and Hillyard, 1983, Hansen and Hillyard, 1988, Donald and Young, 1982). The MMN (MMNm) is elicited by a discriminable change in any repetitive aspect of auditory stimulation. Hence, it is elicited by infrequent changes in the frequency (Hari et al., 1984, Näätänen et al., 1978, Sams et al., 1985a, Alho et al., 1993b, Jacobsen and Schröger, 2001, Berti et al., 2004, Lang et al., 1990, Takegata and Morotomi, 1999; Tervaniemi et al., 2000b, Yago et al., 2001a, Yago et al., 2001b, Sambeth et al., 2006) (Fig. 1), intensity (Lounasmaa et al., 1989, Näätänen et al., 1978, Näätänen et al., 1987b, Näätänen et al., 1987a, Näätänen et al., 1988, Kisley et al., 2004, Novitski et al., 2007) (Fig. 3), the direction of a frequency glide (Sams and Näätänen, 1991, Pardo and Sams, 1993), timbre (Tervaniemi et al., 1997a, Tervaniemi et al., 1997b, Toiviainen et al., 1998), and spatial location (Paavilainen et al., 1989, Picton et al., 2000, Schröger, 1995, Winkler et al., 1998, Kaiser et al., 2000a, Kaiser et al., 2000b, Kaiser and Lutzenberger, 2001, Kujala et al., 1992, Al’tman et al., 2004, Ruusuvirta, 1999, Tata and Ward, 2005, Deouell et al., 2003, Deouell et al., 2006, Sonnadara et al., 2006a, Sonnadara et al., 2006b) of a repetitive sound. Furthermore, changes in complex sounds such as chords also elicit an MMN (Alho et al., 1996, Alho and Sinervo, 1997, Näätänen et al., 1993b, Nordby et al., 1994, Sams and Näätänen, 1991; Schröger et al., 1992, Schröger et al., 1994, Schröger et al., 1995, Schröger et al., 1996, Tervaniemi et al., 1999, Tervaniemi et al., 2000b, Winkler et al., 1998, Winkler and Näätänen, 1993). Also, a frequency change in a continuous tone elicits the MMN (together with the N1) (Lavikainen et al., 1995). In addition, the MMN is elicited by changes in the temporal aspects of auditory stimulation such as sound duration (Kaukoranta et al., 1989; Jaramillo et al., 1999, Jaramillo et al., 2000, Ponton et al., 1997, Grimm et al., 2004, Deouell et al., 2003, Joutsiniemi et al., 1998, Näätänen et al., 1989b, Näätänen et al., 2004b, Michie et al., 2000, Todd and Michie, 2000, Roeber et al., 2003a, Roeber et al., 2003b, Ylinen et al., 2006), rise time (Lyytinen et al., 1992), ISI (Ford and Hillyard, 1981, Hari et al., 1989a, Kujala et al., 2001a, Näätänen et al., 1987a, Näätänen et al., 1993c, Nordby et al., 1988a, Sable et al., 2003), stimulus order (Nordby et al., 1988b, Kujala et al., 2001b, Schröger et al., 1995, Schröger et al., 1996; Tervaniemi et al., 1997a), a gap of a few milliseconds in the middle of a brief stimulus (Desjardins et al., 1999, Bertoli et al., 2001, Bertoli et al., 2002, Uther et al., 2003), and, as already reviewed, stimulus omission in blocks with a short constant SOA (Raij et al., 1997, Yabe et al., 1997, Yabe et al., 1998, Oceák et al., 2006) or the omission of the second tone of two paired tones with a short constant SOA (Tervaniemi et al., 1994b). Moreover, Schröger, 1994, Schröger et al., 1994, Winkler and Schröger, 1995, and Alho et al., 1996, Alho et al., 1993a found an MMN in response to deviance in the temporal structure of a complex spectrotemporal sound pattern consisting of simple tonal segments (Spiegel and Watson, 1981, Port, 1991). This MMN was obtained by infrequently exchanging the positions of two segments of this complex tonal pattern. In addition, Imada et al., 1993a, Kujala et al., 2000 found an MMN by infrequently altering the timing of one part of a repetitive rhythmic pattern. See also Jones and Perez (2002), Vaz Pato and Jones (1999), and Jones et al. (2000)! Consequently, these studies showed that the temporal structure of the sound patterns is encoded in detail by the auditory traces involved in the change-detection process. Hence, it is clear that what is actually stored by the traces underlying the MMN process is sensory information about stimuli (or streams; Bregman, 1990) as events in time rather than as mere static stimulus properties (and, as already reviewed, these traces represent feature-integrated sensory memory). This form of sensory information corresponds to auditory perception (its subjective contents as a dynamic event) and serves the recognition of verbal, melodic, and other crucially time-based information (Näätänen, 1992; Näätänen and Winkler, 1999, Winkler et al., 1997; see also Cowan, 1984). Furthermore, as already mentioned, Winkler et al. (2003b) demonstrated that the MMN is not just a laboratory phenomenon but is, in fact, even elicited by changes in auditory stimulus streams in the middle of every-day sound environment with multiple concurrently active sound sources. The authors presented traffic noise and movie sounds in parallel as background stimulation, overlapped by a sequence of foot-step sounds terminating with a deviant step sound, one resulting from stepping on a piece of glass. Even though all these foot-step sounds were totally inseparable in the acoustic description of the overlapping acoustic events, yet a distinct MMN was elicited by the deviant step sound. Moreover, the MMN elicitation tolerates some range of standard-stimulus variation, both in the feature distinguishing deviants from standards (Winkler et al., 1990) as well as in other features (Gomes et al., 1995, Huotilainen et al., 1993, Winkler et al., 1990). The MMN is also elicited by deviant speech stimuli and by violations of abstract rules followed by the sequence of standard stimuli. These results will be separately reviewed later in the present article.6.1. MMN to different types of auditory change
7. MMN as a function of the magnitude of stimulus change
In general, the MMN amplitude gets larger and peak latency shorter with the increasing magnitude of stimulus deviation. For the frequency change of a sinusoidal tone, this was shown by several studies [e.g., Sams et al., 1985a, Lang et al., 1990, Tiitinen et al., 1994, Berti et al., 2004, Näätänen et al., 1997, Yago et al., 2001a, Yago et al., 2001b, Novitski et al., 2004, Novitski et al., 2007; for an MMN-amplitude increase with increased spectral complexity of stimuli, see Tervaniemi et al., 2000b], for intensity decrement by Näätänen et al., 1989a, Rinne et al., 2006, for intensity increment by Rinne et al. (2006), for duration change by Amenedo and Escera, 2000, Näätänen et al., 1989b, Näätänen et al., 2004b, Jaramillo et al., 2000, for change in the spatial locus of sound origin by Paavilainen et al., 1989, Nager et al., 2003a, for change in the ISI (offset-to-onset) by Näätänen et al., 1993c, Kujala et al., 2001a, and for change in the width of a gap in the middle of a tone stimulus by Desjardins et al. (1999), Bertoli et al., 2001, Bertoli et al., 2002, and Uther et al. (2003). Furthermore, when a deviant stimulus deviates from the standard in two or several attributes, then the MMN amplitude shows additivity (Takegata et al., 1999, Takegata et al., 2001a, Takegata et al., 2001b, Takegata et al., 2001c; Schröger, 1995, Wolff and Schröger, 2001a, Wolff and Schröger, 2001b). This additivity, however, involves the supratemporal but not the frontal component of the MMN (Paavilainen et al., 2003b; see also Wolff and Schröger, 2001b).
8. MMN as an index of discrimination accuracy
In the foregoing, it was suggested that the MMN represents a pre-attentive feature-specific code of stimulus change and, further, that it might provide an objective index of the discrimination accuracy for the different acoustic feature dimensions. This is supported by the fact that, in general, the MMN sensitivity to small stimulus changes seems quite well to correspond to the behavioural discrimination thresholds, which holds both with normal subjects and clinical populations. Some of these studies will be reviewed in this section.
In normal subjects, Lang et al. (1990) found that the accuracy of the behavioural discrimination of a frequency difference between two successively presented tone stimuli strongly correlated with the MMN amplitude (recorded in a separate, passive session). Their subjects were high-school pupils of 17 years in age. Three groups (“good”, “moderate”, and “poor”) were formed on the basis of the accuracy of behavioural pitch discrimination in a same-different task with paired stimuli. In the subsequent MMN recordings (subjects were reading), the standard-stimulus frequency was fixed at 698 Hz, whereas that of the deviant stimulus was different in different blocks. In the good-behavioural-discrimination group, the MMN was elicited with a frequency deviation of 19 Hz; in some of these subjects, 12 Hz was enough. (The ISI used was far too long for the best discrimination sensitivity.) In contrast, with the poor performers, the average deviation had to be increased to 50–100 Hz until an MMN was elicited. The moderate performers took an intermediate position between the two extreme groups (see Fig. 5). Fig. 5. MMN as a function of behavioural pitch-discrimination accuracy. The MMN (recorded in a separate reading condition) was larger in amplitude in school children classified as “good” in a behavioural pitch-discrimination task (Seashore’s test of musicality) than those who were “mediocre” or “weak” in this task. Adapted, with permission, from Lang et al. (1990).
Moreover, employing rhythmic stimulus patterns with an occasional order reversal of two tones belonging to such a pattern, Tervaniemi et al. (1997a) found that subjects detecting these reversals in a discrimination task (a test of musical abilities) with a high accuracy had a considerably larger-amplitude MMN (recorded in a passive condition) than those who showed poor discrimination. For corroborating results with complex stimulus patterns, see Näätänen et al., 1993b, Tervaniemi et al., 2001, van Zuijen et al., 2004, van Zuijen et al., 2005, and Brattico et al. (2002a). In addition, Aaltonen et al. (1994), using phoneme stimuli, found a correlation between the MMN amplitude and the discrimination of minor (within-category) changes in the Finnish vowel /y/. See also Martin et al. (1997); see, however, Sharma et al. (1993)!
Bazana and Stelmack (2002), however, found no correlation between performance and the MMN amplitude, but reported shorter MMN peak latencies in subjects with higher than lower “mental ability” (determined on the basis of a battery of mental-ability tests and academic performance).
With clinical populations, a close relationship between speech perception and the MMN amplitude was found in cochlear-implant patients by Kraus et al., 1995, Groenen et al., 1996, Kelly et al., 2005, Roman et al., 2005. In addition, Aaltonen et al.’s (1993) results with aphasic patients suggest that the MMN, or its absence, could provide specific information with regard to the perceptual deterioration caused by a brain lesion. Two of their patients, those with a posterior left-hemispheric lesion, had a normal MMN to the frequency change of a simple tone, whereas a vowel change (from Finnish /y/ to /i/) elicited no MMN. Furthermore, Kraus et al. (1996), studying school children who were good and those who were bad in discriminating the /ba/ and /da/ syllables, found a distinct MMN for these syllables in the children with good behavioural discrimination only. (For the easier contrast /ba/-/wa/ used, there was no MMN or behavioural difference between the two groups.) Importantly, children with speech-discrimination difficulties were the ones who also had learning problems, suggesting a role of these discrimination difficulties in the emergence of the learning or other problems at school.
The MMN can also reflect improvement in discrimination performance as a result of training. These studies will be reviewed in Section 8.1.
Some studies (e.g., Alho and Sinervo, 1997, Dalebout and Stack, 1999, Kraus et al., 1999, Allen et al., 2000, Paavilainen et al., 2007, Tremblay et al., 1998) even obtained MMNs to changes that were not behaviourally discriminated. In the course of discrimination training, an MMN can appear even before behavioural discrimination ability (Tremblay et al., 1998).
In all these studies, relatively short ISIs were used in order to prevent memory decay from affecting the results. If the ISI is long, then no MMN may be elicited, as already reviewed, probably because the memory trace of the standard stimulus did not last until the moment of the delivery of the deviant stimulus. Using this logic, Pekkonen et al. (1994) were able to separately determine discrimination accuracy and sensory-memory duration for tonal frequency in their patients with Alzheimer’s disease. With a short ISI of 1 s, the authors found no MMN difference between the patients and the controls, concluding that the patients’ discrimination accuracy was not affected. In contrast, with a 3-sec ISI, patients disclosed no MMN, whereas controls still had a distinct MMN. This data pattern permitted the authors to conclude that the sensory-memory decay was expedited in patients with Alzheimer’s disease, whereas their auditory discrimination was unaffected. In the same vein, with a short ISI, there was no MMN-amplitude difference between the young (mean 22 yr) and elderly (mean 59 yr) males, whereas when the ISI was prolonged, then the MMN amplitude was much more attenuated in the elderly than in the young (Pekkonen et al., 1996; see, however, Czigler et al., 1992).
For reviews on the MMN as an index of discrimination accuracy, see Näätänen and Alho (1995, 1997). Näätänen and Alho (1995) proposed that the MMN provides the best available neurophysiological measure of automatic central processing in audition.
In order for the MMN to become a useful tool for every-day clinical practise, one should be able to measure it reliably in single subjects and patients, however (see Lang et al., 1995, Kraus et al., 1999). This would necessitate, in addition to improved paradigms (see Näätänen et al., 2004a, Pakarinen et al., 2007), improved signal-analyzing methods (Picton et al., 2000). For some progress along these lines, see Ponton et al., 1997, Ponton et al., 2000a, Ponton et al., 2000b, Ponton et al., 2002, McGee et al., 1997, Ha et al., 2003, and Marco-Pallares et al. (2005).
For the MMN replicability, see Escera et al., 1999, Escera and Grau, 1996, Frodl-Bauch et al., 1997, Joutsiniemi et al., 1998, Kathmann et al., 1999, Kujala et al., 2001a, Kujala et al., 2001b, Pekkonen et al., 1995; see however, Cacace and McFarland, 2003, Uwer and Von Suchodoletz, 2000. For MMNm replicability, see Tervaniemi et al., 1999, Tervaniemi et al., 2005a. In general, the MMN replicability is quite good at the group level but at the individual level, there still is ample space for further improvement before the MMN provides a reliable tool for clinics at the level of individual patients. A large number of studies showed that with the MMN, one can monitor the progress in sound discrimination. In an early study already referred to, Näätänen et al. (1993b) used a complex spectrotemporal stimulus pattern as the standard stimulus. They found that subjects who were able to detect a slightly deviant pattern in a behavioural discrimination task showed an MMN to this deviant stimulus in a subsequent passive condition (Fig. 6). In contrast, no MMN was elicited in those subjects who were not able to behaviourally discriminate the stimuli in the preceding discrimination condition. However, after they learned to discriminate them during the course of the session, then the MMN was elicited by the deviant patterns in the subsequent passive conditions. Importantly, in another subject group, even a long-duration passive exposure to these complex stimuli resulted in no MMN emergence. For further early MMN studies with these kinds of stimuli, see Schröger et al., 1992, Schröger, 1994. Fig. 6. (Left) Grand-average vertex (Cz) event-related potentials (ERPs) of 7 subjects (reading a book) to standard (dashed lines) and deviant (solid lines) stimulus patterns during the early, middle, and late MMN-recording phases of the session which were each preceded by a behavioural discrimination task. The performance of the subjects in the discrimination test at the early phase was weak but was considerably improved after the second and, in particular, the third phase. This improvement was accompanied by MMN (shadowed area) emergence. The eight-segment stimulus pattern is schematically illustrated at the bottom of the figure. The only difference between the standard (the 6th segment 565 Hz) and deviant (650 Hz) patterns is indicated by the arrow. (Right) Corresponding data for those 5 subjects who were good in discriminating deviants among standards even at the early phase. They had an MMN even in this early phase of the session. Adapted, with permission, from Näätänen et al. (1993b). Subsequently, Atienza et al. (2001), using identical stimuli, corroborated this MMN training effect and, very importantly, showed that it could even be recorded in REM sleep (3 days after the training). Furthermore, in their subsequent study using the same stimuli, Atienza et al. (2004) found evidence suggesting that the MMN might also reflect memory consolidation after training: the MMN recorded after 48 h from the end of the training was considerably larger in amplitude than that recorded after 24 h after the training. Recently, Gottselig et al. (2004) added to this paradigm a second, more difficult, deviant (each deviant being presented at p = .075 in the same stimulus block). The discrimination of one of the two deviants was practiced (6 min.) by one subject group, while a second group practiced the discrimination of the other deviant. The practice-related MMN enhancement was again found but only for the easier deviant, that used by Näätänen et al. (1993b), and this enhancement occurred regardless of which deviant was practiced. Furthermore, the magnitude of this enhancement was highly correlated with the improvement in discrimination. In addition, there was a bilateral superior-temporal MMN source with a left-hemispheric predominance for the easier deviant before and after training, whereas only the right-hemispheric source was strengthened by training. An equivalent training effect, but one with short (8-tone) melodies randomly occurring at 12 different frequency levels, with the deviants having a slightly different contour than that of the standards, was found by Tervaniemi et al. (2001), however in a group of “musical” subjects only. In “nonmusical” subjects, no MMN emerged at any phase of the experiment, and they never learned to discriminate deviants from standards. A corresponding discrimination-training effect but one with phonetic stimuli was found by Kraus et al. (1995) who used different (within-category) variants of the /da/ syllable initially impossible for subjects to discriminate from one another. Importantly, the training effect, i.e., the improved discrimination performance along with the enhanced MMN amplitude, was present even at one month from the end of the training. In addition, Kujala et al. (2003) studied the MMNm to Morse-coded syllables before and after an intensive Morse-code training period of 3 months. They found that, initially, the MMNm to changes in the Morse-coded syllables was, on average, larger in the hemisphere opposite to the one dominant for the MMNm to changes in native-language speech sounds whereas after the training period of 3 months, the pattern was reversed: the mean Morse-code MMNm became lateralized to the hemisphere that was dominant for the speech-sound MMN. This suggests that memory traces for the Morse-coded acoustic language units develop within the hemisphere that already accommodates the permanent traces for natural speech sounds. The authors suggested that these plastic changes manifest the close associations formed between the neural representations of the tone patterns and phonemes. Further, Menning et al. (2002) trained German subjects to discriminate the different mora durations of Japanese from each other. In Japanese, the “mora” is a temporal unit that divides words into almost isochronous segments (e.g., na-ka-mu-ra). So, in essence, what was practiced was duration discrimination (10 sessions of 1.5 h per day), which resulted in improved discrimination, as reflected by behavioural measures as well as by the MMNm-amplitude increase and peak-latency decrease. In addition, the Japanese subjects showed a more sensitive MMNm than did the German subjects for smaller differences. Furthermore, there were significant differences for the pre- versus post-training MMNm generator loci between the Japanese and German subjects. It was concluded that even in adults, the perceptual learning of non-native mora-timing occurs rapidly and deeply and, further, that the enhanced behavioural and neurophysiological sensitivity caused by training indicates a strong relationship between learning and plastic changes, as reflected by the MMNm, in the cortical substrate. Previously, Menning et al. (2000) succeeded in demonstrating a training effect in the discrimination of frequency differences in a simple sinusoidal tone. Their standard stimulus was 1000 Hz, whereas the deviants were of 1005, 1010, and 1050 Hz. Frequency discrimination rapidly improved during the first training week and thereafter showed small but constant improvements. Furthermore, the N1m to standard stimuli and the MMNm to deviant stimuli increased in amplitude during the training. This enhancement persisted until training was finished but was somewhat decreased at 3 weeks later.8.1. Learning/training effects on the MMN
9. The MMN to speech
9.1. The MMN as an index of memory traces for phonemes
As already mentioned, the MMN (MMNm) is also elicited when speech sounds are presented in a passive oddball paradigm (Aaltonen et al., 1987, Aaltonen et al., 1993, Aaltonen et al., 1994, Alho et al., 1998a, Bradlow et al., 1999, Cheour et al., 1998, Dehaene-Lambertz and Baillet, 1998, Diesch and Luce, 1997, Dehaene-Lambertz, 2000, Friederici et al., 2002, Ikeda et al., 2002, Jacobsen et al., 2004a, Jacobsen et al., 2004b, Honbolygó et al., 2004, Kayser et al., 1998, Kushnerenko et al., 2001, Leppänen et al., 2002, Pihko et al., 1999, Pihko et al., 2005, Csépe, 1995, Aulanko et al., 1993, Kraus et al., 1992, Kraus et al., 1993a, Kraus et al., 1993b, Kraus et al., 1995, Kraus et al., 1996, Kraus et al., 1999, Maiste et al., 1995, Martin and Boothroyd, 1999, Martin et al., 1999, Mathiak et al., 1999, McGee et al., 1996, Phillips et al., 2000, Rinne et al., 1999a, Rivera-Gaxiola et al., 2000; Szymanski et al., 2000; Sams et al., 1990, Savela et al., 2003, Sharma et al., 1993, Sharma and Dorman, 1999, Sharma and Dorman, 2000, Sandridge and Boothroyd, 1996, Sussman et al., 2004, Vihla and Eulitz, 2003 see also Dehaene-Lambertz and Dehaene, 1994). [Some studies (Wunderlich and Cone-Wesson, 2001, Pettigrew et al., 2004a, Pettigrew et al., 2004b) were not able to obtain reliable MMNs with minor speech-sound contrasts, however.] Furthermore, studies using speech sounds also showed that with the MMN, one can probe the permanent language-specific speech-sound memory traces. Näätänen et al., 1997, Dehaene-Lambertz, 1997, Sharma and Dorman, 1999; Szymanski et al., 1999) found that an infrequent vowel deviant presented in a sequence of native-language vowel standards elicited a larger-amplitude MMN when it was a typical exemplar of a vowel category in the subject’s native language (Finnish) than when it was no typical vowel in this language (/õ/ of the Estonian language not existing in Finnish). The vowel-related MMN enhancement originated, according to the subsequent MEG recordings, from the left posterior auditory cortex, suggesting this cortex as the locus of the language-specific vowel traces. In contrast, the concomitant acoustic change necessarily accompanying the vowel change elicited a bilateral auditory-cortex MMN subcomponent. The authors proposed that these long-term, or permanent, traces serve as recognition patterns that are activated by the corresponding speech sounds, enabling one to correctly perceive them, and, further, that these traces provide reference information for pronunciation.
Furthermore, using a similar Finnish-Estonian cross-linguistic design, Cheour et al. (1998) obtained evidence suggesting that the language-specific speech-sound memory traces develop between 6 and 12 months of age (see also Rivera-Gaxiola et al., 2005).
In addition, in French infants (mean age 3.7 mo), Dehaene-Lambertz and Baillet (1998) found that the mismatch response (with positive polarity) for an across-category change of a syllable was larger in amplitude than that for an acoustically equivalent within-category change and differed from it in scalp distribution. Also, as in adults (e.g., Näätänen et al., 1997), the mismatch responses in infants to acoustic and phoneme-category changes occurred in parallel. The dipole calculated for this response for the across-category change was posterior and dorsal to that for the within-category change (see also Dehaene-Lambertz et al., 2000).
The existence of language-specific memory traces for phonemes was also reflected in Finnish–Hungarian (Winkler et al., 1999b), English–Japanese (Phillips et al., 1995), French–Japanese (Dehaene-Lambertz et al., 2000), English–Hindi (Shafer et al., 2004; see also Rivera-Gaxiola et al., 2000), and French–Hindi (Dehaene-Lambertz, 1997) cross-language studies. Furthermore, Aaltonen et al. (1997) found that the MMN amplitude paralleled the perceptual magnet effect (Kuhl, 1991; see also Aulanko et al., 1993). In subjects efficiently categorizing synthesized /i/ and /y/ vowel sounds, the discrimination performance was poorer and the MMN amplitude lower for synthesized vowel pairs in the vicinity of the prototypical /i/ than for the same magnitude of physical change between the two synthesized vowels that substantially differed from the prototype but were still categorized as /i/ (Aaltonen et al., 1997; see also Vihla et al., 2000).
An MMN category effect in the voice-onset time (VOT) continuum for the /da/–/ta/ distinction was found by Sharma and Dorman (1999). Consistent with this, subjects’ behavioural discrimination of a VOT change of an equal magnitude was more accurate across the categories than within the /ta/ category. An analogous result was not obtained in the similar studies of Maiste et al. (1995), Sams et al. (1990), and Sharma et al. (1993), however.
It was also found that French vowel contrasts which initially elicited no MMN in Finnish children of 4–6 years began to elicit it soon after entry to a French Kindergarten (Cheour et al., 2002d; see also Dehaene-Lambertz and Baillet, 1998, Rivera-Gaxiola et al., 2005). Furthermore, learning a second language in adulthood (Winkler et al., 1999b; see also Winkler et al., 1999a; see also Tremblay et al., 1997, Tremblay et al., 1998) also caused an MMN-amplitude enhancement (for reviews, see Kraus and Cheour, 2000, Näätänen, 2001; see also Kuhl, 2004).
Winkler et al., 1999a, Winkler et al., 1999b standard stimulus was a vowel that is perceived as /e/ both by Finns and Hungarians, whereas the deviant stimulus was the Finnish /ä/, which in the Hungarian language (spoken in the Budapest region) belongs to the same phoneme category as the /e/ used as the standard. It was found that Hungarians (of the Budapest region) who knew no Finnish had no MMN to the deviant /ä/ in the ignore condition and were very poor in discriminating it behaviourally from /e/ in the discrimination condition (Fig. 7). In contrast, Hungarians who had lived in Finland for years and learned to speak fluent Finnish had a distinct MMN to /ä/, quite similar to that of native Finns, and were also able behaviourally to discriminate it from /e/. These results thus showed the formation of new phoneme categories as a result of foreign-language exposure and use, with the original wide /e/ category (also incorporating /ä/) being divided into separate /e/ and /ä/ categories, and, further, that with the MMN, one can monitor how adults learn to perceive and discriminate correctly foreign-language phonemes. Fig. 7. MMN to vowel contrasts (top) and performance in a vowel identification task (bottom). Top: grand-mean MMN responses at Fz in Finns (dashed line), in Hungarians fluent in Finnish (solid yellow), and in “naive” Hungarians (not speaking Finnish; (solid green)) to deviants /ae/ (left) and /y/ (right) presented in sequences of a repetitive vowel /e/. No MMN was elicited in “naive” Hungarians by vowel /ä/(/ae/), which is relevant for Finns but not for Hungarians. However, very similar MMNs were elicited by this vowel both in Finns and Hungarians fluent in Finnish. In contrast, vowel /y/, present in both languages, elicited similar MMNs in all groups. Bottom: Group averages of correct identification rates (left) of vowels ä and /e/, and reaction times (right) (standard errors of the mean in brackets). Whereas Finns and Hungrians fluent in Finnish reliably identified these vowels, the performance of “naive” Hungarians was at chance level. The Finns and fluent Hungarians were also faster than “naive” Hungarians in the identification task. From Winkler et al., 1999b.
Importantly, Tremblay et al.’s (1998) MMN evidence for the development of the discrimination ability in the course of training preceded in time the behavioural discrimination of the phoneme contrast trained. Furthermore, Tremblay et al.’s (1997) results showed transfer of a discrimination-training effect to an untrained discrimination. Normal-hearing English speaking adults were trained to discriminate and identify a voicing contrast that does not occur in English but is phonetically salient in Hindi and Eastern Armenian. These subjects were trained to hear that distinction of voice-onset time in a bilabial context, but were evaluated before and after training on their ability to discriminate and identify the voicing contrast both in the bilabial context (training condition) and in an alveolar context (transfer condition). After training, subjects could identify and discriminate both training and transfer contrasts behaviourally. These training and generalization effects were manifested by increases in the MMN area and duration, which were more pronounced over the left than right frontal cortex. There are, however, limitations of foreign-vowel discrimination learning as suggested by MMN data (Peltola et al., 2003).
In addition, cross-linguistic MMN differences in the processing of speech-sound duration were found by Nenonen et al., 2003, Nenonen et al., 2005, Ylinen et al., 2005, Ylinen et al. (2006), and Minagawa-Kawai et al. (2004). Furthermore, Tervaniemi et al. (2006) extended these results to involve even non-speech sounds. They found that the MMN to the duration decrement of a simple sinusoidal tone was much larger in amplitude in Finns than Germans. (In German, duration is not linguistically equally relevant as it is in Finnish.) Behavioural duration discrimination, too, was more accurate in the Finnish than German subjects. In contrast, in frequency discrimination, there was neither MMN nor behavioural difference between the two subject groups. Previously, Jaramillo et al. (1999) found that Finnish subjects’ MMN for duration changes was larger in amplitude when these duration changes occurred in speech sounds than when they occurred in acoustically equivalent complex tones.
Moreover, as already mentioned, Menning et al.’s (2002) German subjects were inferior to Japanese ones in behavioural duration discrimination (with Japanese speech sounds) and also had a less sensitive MMNm than that of the Japanese subjects for these changes, apparently because duration discrimination is much less important for understanding German than Japanese.
Further, Weber et al. (2004) studied German infants’ perception of the trochaic stress pattern (stress on the first syllable of the word), the most common stress pattern in German, helping one to segregate consecutive words from one another. It was found that an MMN was elicited by trochaic stress-pattern stimuli among iambic standards (stress on the second syllable) in 5 months old but was not elicited in 4 months old German infants. This result demonstrates a clear development between 4 and 5 months in the processing of the different stress patterns relevant for word recognition. (For P3a data suggesting that changes in prosody have a powerful attention-catching quality, see Wang et al., 2005b).
Finally, new perspectives to the very early speech-sound learning were opened by Cheour et al. (2002a) who found that sleeping newborns can learn to discriminate vowels. Before the sleep, they had no MMN to the Finnish /y/–/i/ contrast but had one after they were exposed to this stimulation in sleep (see Fig. 8). Fig. 8. Left: There was no MMN for the /y/i/–/y/ contrast in sleeping newborns in the evening (dashed line) but a large MMN was elicited in these infants (still sleeping) in the morning (solid line) after noctural training using these stimuli. Middle: In Control Group I, receiving no training, and right: In Control Group II, trained with the /a/–/e/ contrast, there was an MMN for the /y/i/–/y/ contrast neither in the evening nor in the morning (from Cheour et al., Nature 2002).
9.2. Normalization of speech sound perception as reflected by the MMN
Most of the MMN studies with speech sounds used only one (acoustically constant) exemplar of each phonetic category included, however; therefore, the MMN obtained could, at least in most studies, be due either to phonetic-category or mere acoustic change. In fact, as already mentioned, both types of changes contribute to the MMN obtained, with the acoustical MMN being bilaterally generated and the purely phonetic MMN in the left hemisphere only (in most subjects) (Näätänen et al., 1997).
In order to eliminate the acoustic component, Dehaene-Lambertz and Pena (2001) used, in one of their conditions, 3 different female speakers for the 3 exemplars of a standard (/ta/) presented before a deviant (/pa/, or vice versa) always uttered by the same, fourth, female. Nevertheless, a mismatch response in sleeping newborns was obtained. Furthermore, this response was very similar to that elicited in the same-speaker condition of the study. These remarkable results showed that even a sleeping infant’s brain continuously performs speech-sound normalization, a necessary prerequisite for correct speech perception. See also Phillips, 2001, Rivera-Gaxiola et al., 2000, Sharma and Dorman, 2000.
Moreover, Shestakova et al. (2002b) used 150 different male-voice exemplars of each of the three vowel (a, u, i) categories involved. These vowels were presented in short sequences of each category with continuously varying exemplars (standards), there being no break before the onset of the sequence of another vowel (e.g., 10 exemplars of /a/, followed by 10 examplars of /u/, and these followed by 10 exemplars of /i/). Hence, the first stimulus of each sequence served as a deviant stimulus. An MMNm response was obtained above the left hemisphere only; hence, the acoustic MMN component was abolished (also, see Jacobsen et al., 2004b, for abstraction from F0 and intensity variation in the categorization of Klatt-synthesized phonemes).
Obviously, this left-hemispheric phonetic MMNm component depended on the presence of the long-term memory traces for the mother-tongue vowels, which are able to identify the invariant vowel-identity code amongst wide acoustic variation. This code must be identical, or almost identical, in any sound perceived as, for instance, /e/ irrespective of whether it is uttered by a male, female, or child voice. The core property of this phoneme-identity code hence must be its invariance in the midst of very wide acoustical variation, suggesting that there must exist neuronal populations which detect such an invariance. As this invariance can involve no level of any acoustical feature per se, then it probably is of relational nature, i.e., the phoneme identity might be based on fixed relations or ratios between the different levels of certain acoustic features (Näätänen, 2001).
Importantly, the existence of such types of neuronal populations was demonstrated by Paavilainen et al. (1999). In one of their conditions, the within-pair frequency change was ascending both for the standard and deviant pairs but the standard pairs had a constant within-pair frequency ratio between the two tones (5 musical steps), whereas the deviant pairs either had a larger (7 or 8 steps) or smaller (2 or 3 steps) within-pair frequency ratio than that of the standards. Further, the stimulus pairs randomly varied over a wide frequency range. Nevertheless, an MMN was elicited by deviant pairs. Moreover, an analogous result was obtained even when the two tones were simultaneously presented as a complex tone consisting of two frequency components (with the frequency level of the stimuli again varying across an extensive frequency range).
For an ingenious way to test the FUL (featurally underspecified lexicon) model of speech-sound perception in the presence of acoustic variation by the MMN, see Eulitz and Lahiri (2004).
For recent reviews of MMN studies of phoneme perception, see Dehaene-Lambertz and Gliga (2004), Näätänen (2001), and Kraus and Cheour (2000).
9.3. An electrophysiological index of match with a speech-sound trace
One might wonder whether there is any electrophysiological sign of the standard stimulus matching the postulated speech-sound trace. The first electric sign of the speech-sound specific recognition activation was reported by Hoppe et al. (1996) who found a negativity peaking at about 170 ms (“N170”) from phoneme onset, which was not elicited by the noise analog of the stimulus. This bilateral (Rosanovski et al., 1999) “N170” is, presumably, generated when the sound-elicited process in the central auditory system encounters the corresponding recognition model or trace in the sensory-memory system and might hence manifest a read-out of the corresponding phonetic code to perception.
In addition, using sinusoidal tones, Näätänen and Rinne (2002) described a “repetition negativity” which was elicited by a few consecutive repetitions of a tone in a randomized sequence of simple tones with different frequencies. This negativity was also found when complex tone stimuli were used. (See also Kaernbach et al., 1998, Berti et al., 2000, Wolff and Schröger, 2001a.) Moreover, Haenschel et al. (2005) described a slow positivity to repetitions (“repetition positivity”) of a non-speech standard stimulus, suggesting that this positivity is a neurophysiological sign of the memory-trace formation. In their subsequent study, Baldeweg et al. (2006) found that this positivity, and thus the MMN yielded by difference waves, was amplified by nicotine.
The phoneme traces discussed in the afore-going might also provide the sensory information needed in the production and control of the pronunciation (Näätänen, 2001). Trying to learn the correct pronunciation for a foreign speech sound could be described as an iterative process in which the goal is to produce the pronunciation that would match with the sensory information encoded in the trace of this target speech sound. Actually, in this exercise, one tries, presumably, by his or her own voice, to activate his or her own phoneme, syllable, and word traces by using this activation as feedback. Therefore, the accuracy of sensory information in these traces for foreign speech sounds probably sets the upper limit for the individual accuracy of pronouncing these sounds. Hence, in an attempt at improving pronunciation, one should first try to improve the informational accuracy of one’s own speech-sound traces.
9.4. The MMN and the “phonological mismatch negativity” (PMN)
When an attended linguistic input violates contextual expectations, for example, when the subject reads or hears a sentence “the pizza was too hot to sing”, a negative ERP response called the N400 is elicited by the incongruent word, the word “sing” in this example (Kutas and Hillyard, 1980, Kutas and Hillyard, 1984, Connolly and Phillips, 1994, Hagoort and Brown, 2000). Thus, the N400 appears to indicate linguistic processes activated by a semantic mismatch between the expected linguistic input and the perceived word. However, in the auditory modality, the N400 is preceded by an earlier negative response called the phonological mismatch negativity (PMN; Connolly and Phillips, 1994, Hagoort and Brown, 2000, Revonsuo et al., 1998, van den Brink et al., 2001). The PMN appears to be generated by a mismatch between the phonological structure of the expected word and that of the perceived words. For instance, a word that is not the most probable ending of a sentence but still ends it logically elicits a PMN (e.g., the last word of the sentence “when the power went out the house became quiet”, the word “dark” being the most expected ending). The distinction between the PMN and N400 is also supported by differences in their scalp topographies (Connolly et al., 2001, D’Arcy et al., 2004) and by the fact that isolated words and non-words in priming and phoneme-deletion tasks elicit the PMN (Connolly et al., 2001, Newman et al., 2003). In a recent MEG study, Kujala et al. (2004) found that the PMN was generated in the anterior parts of the temporal cortex in response to isolated spoken words and non-words that differed from the word or non-word mentally created by the subject in a rhyming task. However, no study so far has directly compared the PMN source loci with those of the MMN elicited by a phoneme change. However, the fact that attention to auditory input is needed for the PMN to be elicited strongly suggests that different auditory-cortex mechanisms underlie these responses.
10. The MMN for higher-order linguistic processes
10.1. The MMN as an index of mother-tongue syllable and word traces
Very importantly, with the MMN, one can also probe the memory representations of higher-order linguistic phenomena. MMN evidence for memory traces of mother-tongue syllables was reported by Shtyrov et al., 1998, Shtyrov et al., 2000 and Alho et al. (1998a), while similar evidence for morphemes was obtained by Shtyrov and Pulvermüller, 2002a, Shtyrov and Pulvermüller, 2002b and Shtyrov et al. (2005). Furthermore, Korpilahti et al. (2001), Pulvermüller et al. (2001a), and Shtyrov and Pulvermüller, 2002a, Shtyrov and Pulvermüller, 2002b were the first to show that even the memory traces of mother-tongue words can be probed with the MMN. For instance, Pulvermüller et al. (2001a), using Finnish subjects instructed to ignore sound stimuli and to watch a silent movie, found that the MMN to the same spoken Finnish syllable as a deviant stimulus was larger in amplitude when it ended a Finnish word than when it ended a pseudoword. This enhancement, reaching its maximum amplitude at about 150 ms from the word’s recognition point (Marslen-Wilson, 1987), did not occur in foreign subjects not knowing Finnish (Fig 9). In addition, the subsequent MMNm recordings showed that the major intracranial source of this word-related MMN was located in the left superior temporal lobe. Fig. 9. The MMNs elicited by the critical syllables /ki/ (A) and /ko/ (B) when placed in a word context (dark traces) and in a pseudo-word context (light). The acoustic waveforms of these syllables which elicited the MMNs are shown at the top. Data from native Finnish speakers are presented in the upper plots, those from foreigners appear at the bottom. A word-related MMN enhancement occurred in Finnish speakers but not in foreigners (from Pulvermüller et al., 2001a).
These results hence suggested that the MMN (MMNm) can reflect the activation of the permanent neuronal memory traces for mother-tongue words. The memory traces for words are likely to be realized as distributed, tightly connected populations of neurons (Pulvermüller, 1999, Pulvermüller, 2001, Shtyrov and Pulvermüller, 2002a, Shtyrov and Pulvermüller, 2002b) which become fully active, or “ignite,” when words are being processed (for a discussion, see Pulvermüller, 1999). In contrast, after the presentation of a pseudoword that does not occur in the usual language input, the ignition process would fail to emerge.
The relevant differences between the word and pseudo-word contexts emerged as early as at around 150 ms after the word recognition point. This is consistent with results (e.g., Pulvermüller et al., 1995; Skrandies, 1998) indicating that the neuronal counterparts of words become active early, within the first quarter of a second after the relevant information occurs in the input.
Pulvermüller (1999) points to the fact that if two syllables form a word, then they must frequently occur in succession, whereas if two syllables form a pseudo-word, then they may never, or only extremely rarely, occur in direct succession. Therefore, it might, according to him, be that the co-occurrence or correlation statistics of the two syllables included in the stimulus words and pseudo-words was the relevant factor reflected in the MMN amplitude, rather than the word or pseudo-word property of words per se. Only in the case of frequently occurring sequences, such as the phoneme and syllable sequences that represent words of a language, the CNS can build up a neuronal representation. Thus, if a syllable combination is a word, then it is necessarily characterized by an enhanced conditional probability of its component syllables. [See also Bonte et al. (2005), to be reviewed later.]
These results were corroborated by Shtyrov and Pulvermüller, 2002a, Shtyrov and Pulvermüller, 2002b, Pettigrew et al., 2004b, Pettigrew et al., 2005, Sittiprapaporn et al., 2003. Furthermore, Pulvermüller et al. (2003) found that the word-related MMNm enhancement originated from two left-hemispheric activation loci: one superior-temporal and the other inferior-frontal, peaking at 136 and 158 ms, respectively, from the word-recognition point. These areas are known to be crucial for language processing in most right-handed individuals (Zatorre et al., 1994, Price, 2000).
Evidence for the word-trace related MMN enhancement was also obtained by Pulvermüller et al. (2004). Very interestingly, they also found that this MMN enhancement exhibited differential topographies for the two individual Finnish words used. A bilateral, though left-hemispherically predominant, temporo-parieto-occipital set of generators accounted for the word lakko (strike), whereas the word lakki (cap) primarily activated widespread generators in the right hemisphere. These specific generators were activated by the words, in addition to the known sources in the perisylvian language areas activated by words and pseudowords alike (Pulvermüller et al., 2001b). Thus, generators located outside the left-hemispheric core language areas of Broca and Wernicke appeared to contribute to the word-related MMN enhancement.This is consistent with Pulvermüller’s (1999) suggestion that words are represented in the brain by distributed neuron webs linking phonological information mostly stored in the left-hemispheric language areas to semantic information involving additional cortical areas in both hemispheres.
The temporal dynamics of the MMN enhancement for words may also be of theoretical interest. Modular models of language processing postulate a staged or cascaded access to the different types of linguistic information in word perception and comprehension. Accordingly, a word would first be physically analyzed. Then, its phonological pattern would be extracted, which would be followed by lexical access, i.e., the lookup of the word form in a mental dictionary. Finally, semantic information associated with the word would be activated.
In contrast to these modular theories, Marslen-Wilson and Tyler (1975) suggested, on the basis of behavioural data, that phonological, lexical, and semantic information about a word is accessed near simultaneously as soon as the information in the sensory input allows for word identification. This view was supported by Pulvermüller et al. (2004). In their study, the ERP differences between the two individual critical syllables used, [ki] versus {ko], appeared in the same time interval as those between the word and pseudoword contexts, and these, in turn, were present simultaneously with the between-word differences in the MMN-enhancement topographies. Whereas physical stimulus analysis and linguistic processing may be serial (Assadollahi and Pulvermüller, 2001, Assadollahi and Pulvermüller, 2003, Rinne et al., 1999a), Pulvermüller et al.’s (2004) ERP data indicate that the linguistic processes of access to phonological and lexical, and possibly even to semantic, information about a word occur nearly simultaneously in the brain (see also Pulvermüller, 2001). The authors concluded that the activation of the memory traces for specific spoken words in the brain starts as early as at about 100–150 ms after the information in the input is sufficient for word recognition, i.e., the word-recognition point.
Further data indicating word- and word-category specific topographies of the word-related MMN enhancement were obtained by Shtyrov et al., 2004, Pulvermüller et al., 2005 who in an ignore condition recorded auditory ERP responses to movement-related English words. The MMN to action words disclosed an unusual centro-posterior distribution, suggesting that this activity was, at least in part, generated posteriorly to the usually observed frontal MMNs. Moreover, responses to the hand-related word deviant (pick) had a more widespread lateral distribution, whereas the leg-related deviant (kick) elicited a more focal dorsal negativity. These differences, remarkably reminiscent of the sensorimotor cortex topography, were explained in terms of distributed neuronal assemblies that function as category-specific memory traces for words and might involve sensorimotor cortical structures for encoding action words. The observed effects occurred early in time, suggesting that semantic processing may commence as early as at ∼140 ms after word onset.
Hence, it appeared that words are encoded in the brain by distributed neural networks encompassing cortical structures beyond the core language areas (Pulvermüller, 2001, Martin and Chao, 2001, see also Pulvermüller, 2005). This is also supported by studies in patients with specific semantic deficits, indicating that body-part knowledge is a distinct and dissociable semantic category that can be selectively preserved or impaired (see Coslett et al., 2002).
Furthermore, Endrass et al. (2004) found that bilateral redundant stimulus presentation resulted in a further enhancement of the MMN amplitude for words relative to both unilateral stimulus modes. This bilateral redundancy gain was absent for pseudowords. According to the authors, this was the first study to reveal a bilateral redundancy effect for spoken words. The authors stressed the fact that only learned stimuli, such as words or familiar faces, elicit a bilateral advantage in behavioural tasks and therefore suggested that the corresponding MMN enhancement can be explained within the cell-assembly theory. Accordingly, no summation effect could be obtained for complex unfamiliar stimuli, such as pseudowords or unfamiliar faces, as there is no corresponding long-term memory trace. In contrast, strong summation effects following redundant bilateral presentation can be expected for stimuli that are cortically represented by distributed neuronal ensembles with strong internal connections (Pulvermüller and Mohr, 1996, Mohr and Pulvermüller, 2002).
In a fully counter-balanced study using a cross-linguistic approach to control for stimulus effects, Jacobsen et al. (2004b) found an enhanced MMN to deviants presented in a language-familiar context, rather than a larger MMN to lexical than non-lexical deviants. Recently, they showed that this familiar- context effect is not limited to words, but rather appears to be grounded on more general mechanisms of processing familiar sounds (Jacobsen et al., 2005). Diesch et al. (1998), addressing the role of lexicality of the standard, however, found that the MMNm amplitude for non-word deviants was larger when standards were phonological non-words than when they were words. Moreover, for word standards, the MMNm-dipole location for non-word deviants was more lateral than when these deviants were presented against the background of non-word standards.
10.2. The MMN as an index of language laterality
MMN studies (e.g., Gootjes et al., 1999, Mathiak et al., 1999, Näätänen et al., 1997, Kasai et al., 2001) have also significantly contributed to the issue of the predominantly left-hemispheric lateralization of the language function (for reviews, see Hugdahl, 2002, Tervaniemi and Hugdahl, 2003) which is still not fully understood. The two main views are that laterality is best explained by (1) left cortical specialization for the processing of spectrally rich and rapidly changing sounds (Tallal et al., 1993, Zatorre and Belin, 2001), or (2) a predisposition of one hemisphere to develop a module for phonemes (Liberman and Whalen, 2000, Whalen and Liberman, 1987). Shtyrov et al. (2005) tested these two views in a passive oddball paradigm by recording the MMNm to the same brief acoustic stimulus as a deviant stimulus placed in contexts where it was perceived either as a noise burst with no resemblance to speech, or as a native-language sound /t/ being part of a meaningless pseudoword. In a further condition, the same acoustic element was placed in a word context. Results showed that left-laterality was maximal when the critical [t] stimulus was in word context and served its role as an inflectional affix conveying grammatical information. Laterality was significantly reduced when the [t] sound did not have a grammatical function, a finding not easily explained by the motor theory of speech perception or other purely phonological approaches to laterality. As laterality was entirely absent for the MMN elicited by the spectrally rich sound, these data also challenge physical/acoustic theories of laterality, although a null effect in an imaging experiment never constitutes strong evidence against a model. What Shtyrov et al.’s (2005) data strongly suggest is that, apart from physical and phonological factors, the left laterality of the brain response is also influenced by the grammatical and serial-order mechanisms.
Hence, these results demonstrate, according to the authors, that language laterality is bound to the processing of such brief sounds as units of frequently occurring meaningful items and can thus be linked to the processes of learning and memory-trace formation for such items rather than to their physical or phonological properties, i.e., it was the activation of these memory networks for the known items that produced the larger left-right asymmetry for words than non-words. The authors stressed that a prominent left-hemispheric dominance was seen only for stimuli familiar to the central nervous system which had previously developed memory networks for them: The same identical rapid complex sound did not produce significant laterality when presented in the context of meaningless items; this was regardless of their being speech/language or not. This rules out, according to the authors, an explanation of their data using the phonological approach to laterality (Liberman and Whalen, 2000).
In their previous study, Shtyrov et al. (1999) found that complex deviants with fast transitions not heard as speech sounds (when presented among standards of the same type) did not elicit a left-predominant but rather a bilateral MMNm (whereas an acoustically matched consonant–vowel syllable did). Furthermore, this bilateral MMNm became right-hemisperically predominant when the complex non-speech sounds (both standards and deviants) were made slower. Interestingly, the same MMNm shift towards right-hemispheric lateralization also occurred when speech sounds were presented in noise.
Recently, it was also shown that the association between a sound and a body action may play a role for laterality of the MMN: Hauk et al. (2006) found that click sounds produced with the tongue elicited a bilateral MMN, whereas a click sound produced by snipping the fingers gave rise to a left-lateralized MMN with a main source consistent with hand motor cortex. Interestingly, subjects reported that their preferred hand for finger snipping was the right, thus making it plausible that sound-motor associations contributed to laterality.
Rinne et al. (1999a), too, aimed at determining the stimulus prerequisites of the left lateralization of the MMN to speech sounds. The authors generated two continua of 8 auditory stimuli. One continuum ranged from a semisynthetic Finnish vowel /a/ (as in “but”) to the corresponding pure tone produced by passband filtering the vowel /a/. This tone was then step-by-step complemented by widening the filter until it became the original /a/. The other continuum, produced in an analogous way, had the Finnish /i/ at one end and the corresponding tone at the other end. Native Finnish speakers were presented with a repetitive stimulus (standard) which was taken from the /a/ continuum. Each of the 8 sounds served as the standard in separate conditions. In different conditions, this sound was infrequently replaced by the corresponding, equally complex sound from the /i/ continuum. It was found that the MMN became left-lateralized at the same time when the two stimuli were perceived as vowels.
Consistent with this, Tremblay et al. (1997) observed that while MMNs elicited by nonnative speech syllables were initially symmetric, they became enhanced in particular over the left hemisphere following training (see also Tremblay and Kraus, 2002). A similar shift to left-hemisphere predominance was also observed by Kujala et al. (2003) for deviant Morse patterns as a result of intensive Morse-code training. In addition, Sharma and Kraus (1995) found that the MMN elicited by the syllable /da/ was larger in amplitude over the left than right hemisphere when /da/ signaled a phonetic change but was symmetric when the same /da/ signaled a pitch change. Moreover, Zhang et al. (2000) found an MMNm-amplitude enhancement over the left hemisphere, and a parallel amplitude attenuation over the right hemisphere, as a Japanese subject learned to discriminate the English /la/ and /ra/. For further related studies, see Zhang et al., 2005, Koyama et al., 2000a, Koyama et al., 2000b, Koyama et al., 2000b, and Sittiprapaporn et al. (2003).
Similarly, Sharma et al.’s (1994) patient with a left temporal-lobe lesion was able normally to behaviourally discriminate a pitch change: yet his perception of the phonetic contrast with an equivalent pitch change was severely impaired. (See also Aaltonen et al., 1993.) Consistent with this, as already reviewed, the MMN was present when /da/ signaled a pitch contrast but was absent when it signaled a phonetic difference (for a review, see Kraus and Cheour, 2000).
Taken together, these results on the laterality of the MMN now indicate that a number of factors may contribute to the laterality. Physical factors can play a role as well as phonological ones, but, in order to obtain the full-fledged pattern of language laterality, it seems to be necessary that words with grammatical endings are being processed. This finding is in tune with earlier observations (Neville et al., 1992, Pulvermüller et al., 1995) that the laterality of brain responses is the strongest for grammatical words, so-called function (or closed-class) words, and suggests that, apart from the physical and phonological determinants of laterality, sequential processes and syntax play a role as well. As an additional factor, the association of sounds with motor actions appears to co-determine laterality. These results are in line with a memory-trace theory of the MMN. The laterality of the MMN would thus be explained in terms of lateralized memory traces for stimulus-feature sets, phonological units (speech sounds), sensorimotor processing (sound–action links), and grammatical processing (see also the paragraphs of grammar below).
10.3. The MMN as an index of grammar processing
Very interestingly, MMN data also provide evidence for the automatic processing of grammar. Pulvermüller and Shtyrov, 2003, Shtyrov et al., 2003 subjects watching a silent video film and ignoring speech stimuli were presented with grammatically incorrect sentences (with a probability of 16.7%) as rare deviant stimuli against ungrammatical word strings used as frequent standard stimuli. In the reverse design, the ungrammatical items were the rare deviants and the grammatical sentences the frequent standard stimuli. Whereas the brain responses to the frequently presented standard stimuli did not distinguish between grammatical and ungrammatical items, the MMN was significantly enhanced for the violations as compared with that elicited by correct sentences. This grammaticality effect had its main source in the left frontal cortex. This result indicates that the MMN mechanism is at work when these grammar effects are elicited. The authors related the syntactic MMN to differential activation of neuronal memory traces for grammatical word sequences (called “sequence detectors”, see Pulvermüller and Shtyrov, 2003, Pulvermüller, 2002). The study demonstrated, according to the authors, for the first time that the brain detects grammatical violations even when subjects are instructed to direct their attention away from the language input, i.e., that early syntax processing in the human brain may take place outside the focus of attention.
These results were confirmed and extended by Shtyrov et al. (2003) who found that occasional syntactically incorrect stimuli as deviant stimuli elicited larger-amplitude MMN responses than those elicited by correct phrases as deviant stimuli. This grammar-violation dependent MMN enhancement originated from the left temporal cortex, suggesting that this brain structure may play an important role in automatic grammar processing.
The syntactic MMN revealed by a number of studies (Menning et al., 2005; Pulvermüller and Shtyrov, 2003, Shtyrov et al., 2003; see also Gunter et al., 2000, Hahne and Friederici, 1999, Friederici et al., 1996, Friederici et al., 1999, Friederici et al., 2000) is an early left-anterior negativity similar to the ERP responses previously associated with the processing of grammatical violations (Neville et al., 1991, Friederici et al., 1993). These “early left-anterior negativity (ELAN)” responses can be separated from the late ERPs also elicited by word sequences that put strong demands on the grammatical processing system. In contrast to the early lateralized negativities, the late responses are not lateralized and require attention in order to be elicited (for discussion, see Pulvermüller and Shtyrov, 2006). Especially their lateness and lack of laterality bring up the question of whether they reflect genuine grammatical processes or rather late processes of reinterpreting an apparently incoherent word string. The earlier suggestion that only the late response might be sensitive to specific types of grammatical violations, especially violations of the agreement between the subject and the predicate, cannot be maintained, as early left-anterior negativities and syntactic MMNs could be elicited by this kind of violation (see also Münte et al., 1998).
Recently, Menning et al. (2005), corroborating the results of Shtyrov et al., 2003, Pulvermüller and Shtyrov, 2003, found that MMNm responses were considerably larger in amplitude for syntactic and semantic errors than those for mere phonemic deviations and, further, that the semantic errors elicited larger-amplitude MMNm responses than did the syntactic errors. The authors interpreted the error-sensitive MMN response as reflecting a very early detector for semantic and syntactic errors both occurring in the same time window. According to the authors, these results are of great interest in view of the fact that one of the most fundamental claims from linguistics is that semantics and syntax constitute separate types of information. The “syntax-first models” (e.g., Frazier and Clifton, 1996) often assume serial processing in that certain syntactic operations precede semantic processing, stressing that initial structure building based on syntactic principles is immune to semantic or pragmatic information (see Friederici et al., 1993). In contrast, constraint-based models claim the parallel processing of all information sources, and allow for interactions between them (see Marslen-Wilson and Tyler, 1975, Trueswell et al., 1993). Menning et al. (2005) concluded that their result evidently calls for a more parallel view of syntactic and semantic processing (Garnsey et al., 1997), suggesting that the MMN may reflect semantic violations, too, and at a considerably shorter latency than does the classical N400 wave (Kutas and Hillyard, 1980).
10.4. The MMN as an index of phonotactic probability
Very recently, Bonte et al. (2005) found that the MMN also reflects the phonotactic probability, i.e., the distributional frequency of the phoneme combinations, in the listener’s mother tongue. Subjects were presented with pairs of non-words that differed from one another by the degree of phonotactic probability. A modified passive oddball design minimizing the contribution of acoustic processes was used. It was found that a non-word with a high phonotactic probability (notsel) in Dutch elicited a larger-amplitude MMN than did a non-word with a low phonotactic probability (notkel). Thus, auditory cortical MMN responses to phoneme clusters appear to be modulated by the statistical regularities of phoneme combinations. This finding, of great interest in view of the fact that the neural correlates of the phonotactic probability are largely unexplored, may thus, according to the authors, reflect auditory cortical tuning to the distributional frequencies of the phoneme clusters in the language environment and may be related to the extensively reported behavioural finding that stimuli with a high phonotactic probability are easier to acquire, recognize, and memorize (see Auer and Luce, 2003).
Why would, then, a non-word with a high phonotactic probability lead to an enhanced MMN response? Bonte et al. (2005) referred to the Hebbian associative learning principles suggesting that frequently co-occurring events lead to the formation of neural memory representations where these events are together represented. Consistent with this, previous studies (e.g., Nelken, 2004) revealed neural changes in animal primary auditory cortex reflecting the distributional frequencies of simple acoustic features. “The present MMN findings suggest that the frequent exposure to certain phoneme sequences during development, i.e., those with a high phonotactic probability, may lead to enhanced auditory cortical responses and, possibly, to the formation of auditory cortical memory traces. Alternatively, our results may reflect a combination of experience-dependent phonological and basic acoustic influences related to universal principles of phonotactics. It is important to note that these two factors are not independent. Phoneme combinations that are perceptually more distinctive and/or easier to articulate tend to occur more frequently across languages and may thus have a higher phonotactic probability.” (Bonte et al., 2005, p. 2773).
For a recent review on the contribution of the MMN (MMNm) to our understanding of the brain mechanisms of language processing, (see Pulvermüller and Shtyrov, 2006; see also Osterhout et al., 1997).
10.5. The MMN in service of voice discrimination/identification
A novel application of the MMN was proposed by Titova and Näätänen (2001) who used the MMN as an index of voice similarity/dissimilarity. They presented a female voice as a standard stimulus whereas deviant stimuli included one male voice and three female voices. Significant positive correlations were established between the MMN amplitude and the dissimilarity ratings. Moreover, the MMN amplitude proved to be a more reliable indicator of voice identity than the behavioural dissimilarity ratings. Furthermore, referring to the fact that no MMN is elicited when a deviant is identical to the standard, the authors proposed the use of the MMN as a tool of speaker-identity determination. (In fact, they had a fifth “deviant”, one identical to the standard, which of course elicited no MMN.)
10.6. The MMN as an index of voice familiarity
Very recently, Beauchemin et al. (2006) found that the MMN and P3a are enhanced in amplitude for familiar-voice deviants relative to those for unfamiliar-voice deviants. Further, this enhancement was not observed in another group of subjects for whom neither deviant voice was familiar. Their standard was an /a/ (as in the word ‘allo’, the French word for ‘hello’). In addition, there were two deviants in the same stimulus block, this vowel being uttered either by a familiar voice (the subject’s friend or relative) or an unfamiliar voice. The authors concluded that these findings tentatively suggest that “specialized areas for voice processing are especially tuned to familiar voices as opposed to unfamiliar voices” (Beauchemin et al., 2006, p. 3085) and, further, that there is some degree of preattentive voice-familiarity evaluation modulating behavioural discrimination. Hence, this study showed that with the MMN, one can, in addition to the long-term speech-sound memory traces, also probe, and hence demonstrate the presence of, merely acoustic long-term memory traces.
11. The MMN and musical stimuli
Studies using the MMN have also significantly contributed to our understanding of music perception and enjoyment. In their recent review, Tervaniemi and Brattico (2004) concluded that by using the MMN, we can look into the separate submodules of music perception “examining with optimal time resolution the dynamic stages of information processing, as well as their automaticity and possible top-down modulation (which may be determined, for example, by implicit or explicit knowledge of musical sounds)” (p. 15). One important basic finding was that of Tervaniemi et al., 1997b, Toiviainen et al., 1998, Goydke et al., 2004, Caclin et al., 2006 showing that the MMN is elicited by a timbre change. This and related findings highlight, according to Tervaniemi and Brattico (2004), the ability of the auditory cortex to differentiate sounds according to a multidimensional sound attribute such as timbre which in acoustical terms is quite complex but which forms a common cue in our daily auditory scene to differentiate sounds even with the same spatial origin and time course (see, e.g., Bregman, 1990).
Moreover, Tervaniemi et al. (2000b) found that the MMN elicited by a pitch change among harmonically rich sounds is larger in amplitude and earlier in latency than that elicited by pure sinusoidal tones and, further, that the behavioural discrimination of pitch change was more accurate when sounds were harmonically rich than when they were pure tones. Thus, adding acoustical information into sound signal seems to help its neural encoding rather than delaying or complicating it.
In addition, as already mentioned, several studies (e.g., Tervaniemi et al., 1994a, Tervaniemi et al., 2001; for a review, see Näätänen et al., 2001) showed that the memory system reflected by the MMN encodes sound information far beyond the acoustic sound properties. Such findings, to be reviewed in detail in the next chapter, indicate that the auditory cortex automatically encodes, irrespective of whether the subject is listening or not, relatively invariant, abstract, sound information such as melodic, harmonic, and rhythmic auditory information which music is typically composed of. The processing of musical stimuli usually occurs with right-hemispheric weighting, as indicated by MEG (Tervaniemi et al., 1999, Maess et al., 2001), PET (Tervaniemi et al., 2000a), and fMRI studies (see Koelsch and Siebel, 2005).
Of particular importance is the sensitivity of the MMN to changes in the contour of acoustic stimulation as contours are a central element of musical stimulation. As already mentioned, Tervaniemi et al. (2001) found, in an ignore condition, an MMN to changes in the contour of transposed melody-like tone patterns. This MMN, however, was observed in musical subjects only (after subjects had tried to detect the deviant patterns in an active discrimination condition). These musical subjects were musicians who could play their instruments with no score.
Several other studies, too, found the superiority of musicians to non-musicians in processing musical sound material. For example, Vuust et al. (2005) observed that expert jazz musicians had a larger and earlier MMNm response to subtle deviations in rhythm than that of musically inept non-musicians. Furthermore, the musicians’ MMNm for these deviations was left-lateralized, whereas the (smaller) MMNm of the non-musicians was right-lateralized. The authors suggested that this left-lateralization reflects the functional adaptation of their brain to a task of communication which in these musicians is much like that of language when they play jazz together, with subtle rhythmic deviations forming signals of musical communication for them.
Trainor et al. (2002), however, found that even non-musicians’ brains automatically process melodic information (see also Koelsch et al., 2000). The authors observed an MMN to changes both in contour (the up–down patterns of pitch change) and interval (the exact pitch distances between notes) in the absence of absolute frequency information, stressing the fact that of these two forms of information, precise interval processing is specific to music (and is greatly affected by musical training), whereas contour information is important in both musical and speech domains. Subsequently, Fujioka et al. (2004) found that in musicians, both contour- and interval-change MMNms are larger in amplitude than those in non-musicians, however. Importantly, the MMNm elicited by a simple frequency change was of very similar amplitude in the two groups. This suggests that the MMN (MMNm) enhancement due to musical training/talent might be confined to musical stimuli only (being more of abstract rather than sensory nature; see also Tervaniemi and Brattico, 2004). (There were no differences in the hemispheric distribution, however.) Consistent with this, the authors concluded that musical training mainly affects the pitch contour and interval relations between tones rather than the encoding of single tones.
For further MMN studies showing superior auditory preattentive processing in musicians, see Fujioka et al., 2005, Koelsch et al., 1999, Koelsch et al., 2002, Lopez et al., 2003, Rüsseler et al., 2001, Tervaniemi et al., 1997a, Tervaniemi et al., 2005b, van Zuijen et al., 2004, van Zuijen et al., 2005, Brattico et al., 2002a, Brattico et al., 2002b. On the basis of their results, Koelsch et al. (1999) concluded that “the superior discrimination performance of musicians is not only due to processing at higher cognitive levels but also to pre-attentive memory-based processing. Contrary to phoneme processing, this superior automatic discrimination is most probably not due to long-term stored representations (i.e. permanent sensory memory traces), but due to an elaborated mechanism of information acquirement underlying the generation of MMN” (p. 1313).
The MMN has also been used to investigate the processing of musical syntax (e.g., Koelsch et al., 2003a, Koelsch et al., 2003b, Loui et al., 2005, Leino et al., 2007). In these studies, chords with an irregular harmonic function presented within sequences of chords elicited an early anterior negativity which has also been denoted as music-syntactic MMN (Koelsch et al., 2003a, Koelsch et al., 2003b).
Recently, the MMN has also been used to assess music perception in cochlear-implant users in whom a timbre MMN, though one smaller in amplitude than that in controls, can be elicited (Koelsch et al., 2004).
For recent reviews on the import of the MMN in studies of music perception, see Tervaniemi and Brattico, 2004, Münte et al., 2002, Koelsch and Siebel, 2005.
12. Abstract-feature MMNs
As already reviewed, the pre-attentive auditory analysis reflected by the MMN is not restricted only to physical, or “first-order”, stimulus features but rather includes even more complex invariances, ones based on the relationships between various physical stimulus features, either within individual stimuli or between successive stimuli (e.g., Paavilainen et al., 1999). In these so-called “abstract-feature” MMN studies, there is no physically identical, repetitive standard stimulus but rather a class of several physically different “standard” stimuli. The invariant, “abstract”, feature uniting the various exemplars of the standard stimuli is based on some common rule that they all obey.
In a pioneering study, Saarinen et al. (1992) presented their subjects with tone pairs (two 60-ms tone pips separated by a 40-ms silent gap; silent inter-pair interval 640 ms). The position of the tone pairs in the frequency scale randomly varied over a wide range, there being no physically identical, repetitive standard stimulus. Instead, the constant feature of the standard pairs was an “abstract” or “second-order” one, namely, the direction of the frequency change within a tone pair: all the standard pairs were ascending pairs (i.e., the second tone of a pair was higher in frequency than the first tone), whereas the deviant pairs were descending pairs. Thus, the abstract attribute was based on a rule defining the relationship between the simple physical, first-order, attributes of the two tones forming a pair. Nevertheless, the MMN was elicited by the deviant pairs in an ignore condition. This result showed that the preattentively formed sensory representations were capable of encoding the abstract attributes corresponding to simple concepts (“rise”, “fall”), that is, of deriving a common invariant feature from a set of individual varying physical events. For similar results in children aged 8–14 years, see Gumenyuk et al. (2003)! Furthermore, Korzyukov et al. (2003), using a similar paradigm, localized the source of the abstract-feature MMN with EEG and MEG recordings at the auditory cortex. (For studies corroborating and extending these findings, see Paavilainen et al., 1995, Paavilainen et al., 1998). For studies showing abstract-feature MMNs in newborns, see Ruusuvirta et al., 2003, Ruusuvirta et al., 2004 and Carral et al. (2005).
As already reviewed, in addition to the direction of frequency and intensity change, even invariant frequency ratios (musical intervals) can be automatically derived from acoustically varying stimulation (Paavilainen et al., 1999).
What might be the ecological validity of these kinds of studies? The extraction of the invariant relationships from physically varying auditory stimulation is of critical importance to higher perceptual-cognitive functions such as the processing of speech and music. For example, as already reviewed, one usually categorizes phonemes correctly irrespective of considerable variation in the physical “surface” features of the speech signal resulting from the acoustically different voices of the various speakers (e.g., male or female) and the word context. Shestakova et al.’s (2002b) MEG study reviewed in the afore-going clearly demonstrated the existence and operation of such category memory traces that can recognize the corresponding phonemes even in the presence of wide acoustical variation.
Similarly, in music, we recognize melodies irrespective of the key into which they are transposed or of the instrument with which they are played. In their afore-mentioned study, Tervaniemi et al.’s (2001) posed standard stimuli consisted of a melodic pattern that was randomly presented at different frequency levels (simulating a melody randomly played in different keys). Nevertheless, occasional slight contour changes in the patterns widely varying in the frequency level elicited an MMN. This MMN was especially prominent in musicians who perform music primarily without a score. Even in these subjects, some training and attending to auditory stimuli was, however, required for the MMN being elicited (in a later stimulus block). After learning, their auditory cortex hence detected contour changes even when attention was directed away from the sounds.
Consequently, MMN studies can reveal neural mechanisms underlying perceptual invariances essential for higher-level auditory processing. In a further study, Paavilainen et al. (2003a) wished to determine whether the preattentive sound-analysis mechanisms are capable of extracting invariant relationships based on abstract conjunctions between two sound features. Their stimuli were sinusoidal tone pips presented with a silent ISI of 400 ms. The stimuli randomly varied over a large range in two feature dimensions (frequency and intensity), there being neither a physically constant, repetitive standard stimulus nor a physically constant, repetitive feature conjunction. However, a constant relationship between the frequency and intensity of the various exemplars of the standard stimuli was defined by a linear, abstract conjunction rule “the higher the frequency of a stimulus, the louder its intensity”. Subjects ignoring sound stimuli were presented with occasional deviant stimuli that violated this regularity, obeying the opposite rule (for example, an occasional high-pitch tone with a weak intensity). An MMN was elicited even by such deviant stimuli, demonstrating that the preattentive processing of auditory stimuli extends to complex relationships between the different stimulus features.
In a separate, active condition, subjects were asked to press a button to any stimuli that they somehow felt “deviant”. The rule separating the deviant stimuli from the standard stimuli was not told to them prior to this condition. Although subjects detected deviants fairly well, in the subsequent interviews, they usually were not able to explain why they pressed a button to some of the stimuli. Thus, the information extracted by the MMN mechanism was utilized in the active detection condition, but this information appears to have been in an implicit form, difficult to express verbally. Consequently, the present findings might also be relevant to the controversial issue of implicit memory and learning (see, e.g., Shanks and St. John, 1994).
Furthermore, two studies demonstrated that the MMN mechanism also forms extrapolatory traces representing the forthcoming stimuli on the basis of the regularities or trends detected in the auditory past. In the afore-reviewed Tervaniemi et al. (1994a) study (Fig. 2), stimuli consisted of a long sequence of steadily descending tones, i.e., ones following the rule that each tone is lower in frequency than the previous one. It was found that occasional deviant stimuli (an ascending tone or a tone repetition) elicited an MMN. It is noteworthy that, again, all standard stimuli were physically different, and the deviant events were composed of physically similar stimuli that had occurred in the immediate auditory past.
In another study along the same lines, Paavilainen et al. (2007) used sound stimuli that varied in two features, duration and frequency. The stimuli were either short (50 ms) or long (150 ms), and low (1000 Hz) or high (1500 Hz). All combinations (short-low, short-high, long-low, long-high) were presented at p = .25 with an ISI of 300 ms. The duration of each stimulus randomly was either short or long. The stimulus sequences were constructed so that the duration of each stimulus predicted the frequency of the next stimulus so that: (1) if the present stimulus is short in duration, then the next stimulus will be low in frequency; and (2) if the present stimulus is long in duration, then the next stimulus will be high in frequency. Occasional deviant events broke these rules: for example, a high-pitched stimulus following a short stimulus. In this design, all the 4 different stimulus combinations used could appear either as a standard or a deviant event, depending on the duration of the preceding stimulus. Nevertheless, the deviant events elicited, in an ignore condition, an MMN, one peaking at 150–200 ms and reversing its polarity at the mastoids, which suggested a source in the auditory cortex.
In the subsequent attend conditions, subjects were asked to press a button to any stimuli they found somehow “strange” or “deviant”. (The rules were not explained to them prior to the task). An MMN was again elicited, although subjects could detect only about 15 % of the deviant events, and none of them could verbally express the rules in the later interviews. The results suggest that the neural mechanism modeling the auditory environment may automatically “learn” the co-variation between the features of the successive events and make predictions of the properties of the forthcoming stimuli. Further, if the predictions are not fulfilled, then the MMN is generated.
In conclusion, the afore-reviewed MMN studies suggest that the central auditory system performs surprising cognitive operations, such as generalization leading to simple concept formation, rule extraction, and the anticipation of the next stimulus even at the pre-attentive level, demonstrating a kind of “primitive sensory intelligence” in the auditory cortex (for a review, see Näätänen et al., 2001). The information extracted by the sensory-memory mechanisms often seems to be in an implicit form, not directly available to conscious processes and difficult to express verbally. The present results hence are consistent with the framework suggested by Winkler et al., 1996a, Winkler et al., 1996b, according to which the main function of the MMN process is to adjust a neural model to the various regularities of the auditory environment, enabling the central auditory system to manage a large part of its subsequent input automatically, i.e., without requiring the limited resources of the controlled-processing system.
13. Concluding discussion
In the present article, we have reviewed the main areas of the basic research of cognitive brain function using the MMN since the late 1970s when the MMN was described and interpreted. In the next, we will list the principal trends of this research during this period of almost 30 years.
- (1)
From simple to complex stimuli. The early studies (e.g., Näätänen et al., 1978) used simple stimuli such as single sinusoidal tones only. More recently, complex stimuli were also used such as complex tones (e.g., Alho et al., 1996) or repetitive tone patterns (Näätänen et al., 1993b, Schröger, 1994, Schröger et al., 1992, Schröger et al., 1994, Atienza and Cantero, 2001, Atienza et al., 1997, Imada et al., 1993a, Imada et al., 1993b);
- (2)
From artificial to natural stimuli. In addition to becoming increasingly more complex, stimuli have also become more natural. For instance, in recent studies of speech-sound processing, stimuli have often quite closely resembled natural speech sounds (e.g., Shestakova et al., 2002b, Dehaene-Lambertz and Pena, 2001). Moreover, in studies of automatic music processing, natural music extracts were also used (e.g., Lopez et al., 2003, Vuust et al., 2005);
- (3)
From non-linguistic to linguistic stimuli. As already mentioned, the early MMN studies used simple stimuli such as short tone pips. The first speech-sound stimuli were the vowels used by Aaltonen et al. (1987) to investigate vowel discrimination, which were later followed by studies using syllables (Shtyrov et al., 1998, Shtyrov et al., 2000, Alho et al., 1998a) and whole words (Korpilahti et al., 2001, Pulvermüller et al., 2001a, Pulvermüller et al., 2001b). Moreover, the stimulus material got even more complex when MMN studies started to address higher-order linguistic phenomena such as the processing of grammar (Pulvermüller and Shtyrov, 2003), phonotactics (Bonte et al., 2005, Pulvermüller, 1999), or word meaning (Pulvermüller, 2001, Shtyrov et al., 2004, Shtyrov et al., 2005). Hence, in the early studies, the main interest was in the different types of the acoustic MMN, whereas the more recent studies also addressed higher-order MMNs such as phonetic, word-level, syntactic, and semantic ones, too;
- (4)
The increase in the number of the concurrent stimulus channels. The first MMN studies used one, maximally two (typically the two ears) concurrent stimulus streams only. More recently, multiple concurrent stimulus streams were also used (e.g., 3 parallel input channels of Nager et al., 2003b) and two even within the same ear (Sussman et al., 1999, Yabe et al., 2001b, Winkler et al., 1992). This trend has shown that the MMN enables one to study complex issues such as those belonging to Bregman’s (1990) influential auditory scene analysis framework;
- (5)
From short-term (echoic) memory to other forms of memory, too. The MMNs recorded in the early studies probed the neural basis of short-term memory for stimuli presented during the session, with the idea being that these stimulus effects are developed during the session and totally abolished in a few seconds after the cessation of stimulation. It was, however, found quite soon that even non-linguistic stimuli have longer-term effects (e.g., Cowan et al., 1993, Atienza et al., 2001, Atienza et al., 2004, Näätänen et al., 1993b, Gottselig et al., 2004, Menning et al., 2000; see also Winkler and Cowan, 2004). Furthermore, MMN studies using speech sounds (e.g., Dehaene-Lambertz, 1997; Näätänen et al., 1997, Cheour et al., 1998) found that the MMN permits one to probe permanent speech-sound traces, too, i.e., with the MMN, one can reach long-term memory representations. In addition, Pulvermüller et al. (2004) found that these long-term representations are not only auditory but may even involve such representations beyond the auditory modality, e.g., semantic ones (see also Shtyrov et al., 2004).
Furthermore, in the opposite direction, MMN studies have also reached very short-duration memory representations, those shorter than echoic memory. A number of these studies (e.g., Yabe et al., 1997, Yabe et al., 1998) provided novel information of the temporal window of integration (TWI), which is of the order of 200 ms in duration and essential for the understanding of the emergence and formation of auditory percepts, roughly corresponding to Cowan’s (1988) short form of sensory store;
- (6)
From memory to attention switch. Although the possible attention-switching function associated with the MMN was suggested (Näätänen et al., 1978, Näätänen and Michie, 1979), the early studies tended to mainly remain within the framework of memory research. An impact to studies of this attention-switching function was given by Giard et al.’s (1990) convincing demonstration of the frontal-cortex involvement in MMN generation. Then it was natural to associate this frontal component with an attention-switching function so that it would be generated by an attentional-call type of process (Öhman, 1979) and the subsequent P3a by the actual attention switch (Escera et al., 1998). In this way, the MMN became a tool for determining how a pre-conscious sensory process reaches the level of conscious perception;
- (7)
From memory representation of the past to the anticipation of the future. Originally, the MMN was regarded as a tool for probing representations of the past only. More recent studies (e.g., Tervaniemi et al., 1994a), however, showed that the MMN can also reflect anticipatory representations, i.e., predictions of the future events based on the most recent events, and might even be used as a tool for testing hypotheses derived from Friston’s (2005) influential predictive-coding framework (see also Winkler et al., 1996b).
- (8)
From sensory memory to sensory intelligence. The early MMN data could all be accounted for in terms of sensory memory. More recent studies, however, showed that the MMN can also reflect automatic intelligent processes and those even at the level of auditory cortex (for a review, see Näätänen et al., 2001). In addition to stimulus anticipation based on the perceived trend referred to in the aforegoing, several other forms of primitive sensory intelligence were also described such as stimulus generalization (Saarinen et al., 1992, Paavilainen et al., 1995, Paavilainen et al., 1999) and combinational-rule extraction (Paavilainen et al., 2003a, Paavilainen et al., 2007);
- (9)
From adult to developmental research. The early studies were exclusively conducted with (young) adult population, whereas in the 1990s, increasingly more interest was directed to developmental aspects, both to child development (e.g., Trainor et al., 2003, Shestakova et al., 2002a, Maurer et al., 2003a, Maurer et al., 2003b, Morr et al., 2002, Shafer et al., 2000, Oades et al., 1997, Gomes et al., 1999, Tanaka et al., 2001) for reviews, (see Cheour et al., 2000, Leppänen and Lyytinen, 1997, Leppänen et al., 2004) and to aging (e.g., Gaeta et al., 1998, Gaeta et al., 2002, Cooper et al., 2006, Pekkonen et al., 1996, Jääskeläinen et al., 1999a; for reviews, see Kok, 2000, Pekkonen, 2000);
- (10)
From auditory to all sensory modalities. The early MMN studies were exclusively auditory, whereas starting from the early 1990s, more and more interest was directed to the potential MMN equivalents in the other sensory modalities, too: in the visual (e.g., Tales et al., 1999, Pazo-Alvarez et al., 2003), somatosensory (e.g., Kekoni et al., 1997, Shinozaki et al., 1998), and olfactory (Krauel et al., 1999) modalities as well as to MMN expressions of the interactions between these modalities (the auditory–visual integration, see Sams et al., 1991a; Ullsperger et al., 2006);
- (11)
From one-deviant to multi-deviant paradigms. After it was established that there are separate MMN processes for different types of deviations which can yield mutually complementary information, it became desirable to design new, multiple-deviant paradigms that would yield MMNs for several different types of deviations in a reasonable time. [e.g., Näätänen et al., 2004a, Pakarinen et al., 2007.];
- (12)
From the EEG to other methodologies. The early MMN studies were exclusively EEG studies. The first MEG study that provided an MEG analog of the MMN appeared in 1984 (Hari et al., 1984) which was followed by studies demonstrating optical-imaging (Rinne et al., 1999b), PET (Tervaniemi et al., 2000a), and fMRI (Celsis et al., 1999) equivalents of the MMN. In addition, the first intracranially recorded MMN in humans was reported in 1995 (Halgren et al., 1995);
- (13)
From human to animal. The early MMN studies were exclusively conducted with human subjects. In 1987, Csépe et al. (1987), however, demonstrated an animal analog of the MMN in their cat recordings. Subsequently, as reviewed in the afore-going, the MMN was recorded in several other species (rat, mouse, monkey, guinea pig), too;
- (14)
From normal-state to pharmacologically affected subjects. The early MMN studies were exclusively conducted with subjects who were in their “normal” state. Subsequent studies were also interested in the effects of different kinds of pharmacological manipulations on the MMN, however (e.g., Born et al., 1986, Born et al., 1987a, Born et al., 1987b, Born et al., 1987c; Duncan and Keye, 1987, Javitt et al., 1996, Kähkönen and Ahveninen, 2002, Kähkönen et al., 2005, Riekkinen et al., 1997, Pekkonen et al., 2001, Pekkonen et al., 2001, Pekkonen et al., 2005, Umbricht et al., 2002);
- (15)
From the MMN to its neural mechanisms. Very recently, the neural mechanisms of MMN generation have come to the fore (e.g., Javitt et al., 1996, Ulanovsky et al., 2003). It can be predicted that in the near future, there will be increasingly more interest in the neural generation of the MMN, not least because of the opportunity to study memory-trace formation in a novel way. Furthermore, in particular in mouse (see Umbricht et al., 2005), one could also study the genetic determination of the processes involved in MMN studies;
- (16)
From group-level MMN to single-subject MMN. Some recent studies (e.g., Ponton et al., 1997, McGee et al., 1997; see also Ha et al., 2003) also dealt with the issue of the reliable determination of the MMN at the single-subject or -patient level. This would be a necessary prerequisite for developing the MMN as an every-day clinical tool;.
- (17)
From basic to clinical studies. The early studies belonged to the basic research of cognitive brain function but it was realized rather soon that the MMN could be of great asset for different applied and clinical purposes, too. The first ones of these studies were those of Kane et al. (1993), demonstrating that the MMN predicts coma outcome (see also Fischer et al., 2006, Wijnen et al., 2007, Daltrozzo et al., 2007), and that of Kraus et al. (1993b); (see also Ponton et al., 2000a, Ponton et al., 2000b, Lonka et al., 2004, Groenen et al., 1996, Wable et al., 2000) showing that the MMN might index the gradual improvement of speech-sound discrimination after cochlear-implant installation. The MMN studies of different clinical conditions and abnormalities will be reviewed in a parallel article (Näätänen, Kujala, and Escera, in preparation).
Acknowledgements
The authors wish to thank Dr. Friedeman Pulvermüller, Dr. Thomas Jacobsen, and Dr. Rika Takegata for their valuable comments and additions to a the previous version of the present manuscript and Ms. Piiu Lehmus for her competent and patient text-editing work.
References
- Aaltonen et al., 1987Event-related brain potentials and the perception of a phonetic continuumBiol Psychol, 24 (1987), pp. 197-207
- Aaltonen et al., 1993Cortical differences in tonal versus vowel processing as revealed by an ERP component called mismatch negativity (MMN)Brain Lang, 44 (1993), pp. 139-152
- Aaltonen et al., 1994Automatic discrimination of phonetically relevant and irrelevant vowel parameters as reflected by mismatch negativityJ Acoust Soc Am, 96 (1994), pp. 1489-1493
- Aaltonen et al., 1997Perceptual magnet effect in the light of behavioral and psychophysiological dataJ Acoust Soc Am, 101 (1997), pp. 1090-1105
- Akatsuka et al., 2005Mismatch responses related to temporal discrimination of somatosensory stimulationClin Neurophysiol, 116 (2005), pp. 1930-1937
- Akatsuka et al., 2007Objective examination for two-point stimulation using a somatosensory oddball paradigm: an MEG studyClin Neurophysiol, 118 (2007), pp. 403-411
- Alain et al., 1999aSeparate memory-related processing for auditory frequency and patternsPsychophysiology, 36 (1999), pp. 737-744
- Alain et al., 2001Bottom-up and top-down influences on auditory scene analysis: evidence from event-related brain potentialsJ Exp Psychol, 27 (2001), pp. 1072-1089
- Alain et al., 1999bEvent-related brain activity associated with auditory pattern processingNeuroReport, 10 (1999), pp. 2429-2434
- Alain and Izenberg, 2003Effects of attentional load on auditory scene analysisJ Cogn Neurosci, 15 (2003), pp. 1063-1073
- Alain and Woods, 1994Signal clustering modulates auditory cortical activity in humansPercept Psychophys, 56 (1994), pp. 501-516
- Alain and Woods, 1997Attention modulates auditory pattern memory as indexed by event-related brain potentialsPsychophysiology, 34 (1997), pp. 534-546
- Alain et al., 1989Human intracerebral potentials associated with target, novel, and omitted auditory stimuliBrain Topogr, 1 (1989), pp. 237-245
- Alain et al., 2002Neural activity associated with distinguishing concurrent auditory objectsJ Acoust Soc Am, 111 (2002), pp. 990-995
- Alain et al., 1998A distributed cortical network for auditory sensory memory in humansBrain Res, 812 (1998), pp. 23-37
- Alain et al., 1994Brain indices of automatic pattern processingNeuroReport, 6 (1994), pp. 140-144
- Alho et al., 1998aHemispheric lateralization in preattentive processing of speech soundsNeurosci Lett, 258 (1998), pp. 9-12
- Alho et al., 1997Effects of involuntary auditory attention on visual task performance and brain activityNeuroreport, 8 (1997), pp. 3233-3237
- Alho et al., 1993aMemory-related processing of complex sound patterns in human auditory cortex: a MEG studyNeuroReport, 4 (1993), pp. 391-394
- Alho et al., 1993bAuditory processing in the visual brain areas of the early blind: evidence from event-related potentialsElectroencephalogr Clin Neurophysiol, 86 (1993), pp. 418-427
- Alho et al., 1990Event-related brain potential of human newborns to pitch change of an acoustic stimulusElectroencephalogr Clin Neurophysiol, 77 (1990), pp. 151-155
- Alho et al., 1989Event-related brain potentials reflecting processing of relevant and irrelevant stimuli during selective listeningPsychophysiology, 26 (1989), pp. 514-528
- Alho and Sinervo, 1997Preattentive processing of complex sounds in the human brainNeurosci Lett, 233 (1997), pp. 33-36
- Alho et al., 1996Processing of complex sounds in the human auditory cortex as revaled by magnetic brain responsesPsychophysiology, 33 (1996), pp. 369-375
- Alho et al., 1987Brain mechanism of selective listening reflected by event-related potentialsElectroencephalogr Clin Neurophysiol, 68 (1987), pp. 458-470
- Alho et al., 1998bProcessing of novel sounds and frequency changes in the human auditory cortex: magnetoencephalographic recordingsPsychophysiology, 35 (1998), pp. 211-224
- Alho et al., 1994aProcessing of auditory stimuli during auditory and visual attention as revealed by event-related potentialsPsychophysiology, 31 (1994), pp. 469-479
- Alho et al., 1994bLesions of frontal cortex diminish the auditory mismatch negativityElectroencephalography & clinical Neurophysiology, 91 (1994), pp. 353-362
- Alho et al., 1992Intermodal selective attention II: effects of attentional load on processing auditory and visual stimuli in central spaceElectroencephalogr Clin Neurophysiol, 82 (1992), pp. 356-368
- Allen et al., 2000Neural representations of consciously imperceptible speech sound differencesPercept Psychophys, 62 (2000), pp. 1383-1393
- Al’tman et al., 2004Changes in evoked potentials during the action of sound signals with different localizing characteristicsNeurosci Behav Physiol, 2 (2004), pp. 139-146
- Amenedo and Escera, 2000The accuracy of sound duration representation in the human brain determines the accuracy of behavioural perceptionEur J Neurosci, 12 (2000), pp. 2570-2574
- Arnott and Alain, 2002Stepping out of the spotlight: MMN attenuation as a function of distance from the attended locationNeuroReport, 13 (2002), pp. 2209-2212
- Assadollahi and Pulvermüller, 2001Neuromagnetic evidence for early access to cognitive representationsNeuroReport, 12 (2001), pp. 207-213
- Assadollahi and Pulvermüller, 2003Early influences of word length and frequency: a group study using MEGNeuroReport, 14 (2003), pp. 1183-1187
- Astikainen et al., 2000Cortical and subcortical visual event-related potentials to oddball stimuli in rabbitsNeuroReport, 11 (2000), pp. 1-3
- Astikainen et al., 2005Longer storage of auditory than visual information in the rabbit brain: evidence from dorsal hippocampal lectrophysiologyExp Brain Res, 160 (2005), pp. 189-193
- Astikainen et al., 2004The human brain processes visual changes that are not cued by attended auditory stimulationNeurosci Lett, 368 (2004), pp. 231-234
- Astikainen et al., 2006Memory-based detection of rare sound feature combinations in anaesthetized ratsNeuroReport, 17 (2006), pp. 1561-1564
- Atienza and Cantero, 2001Complex sound processing during human REM sleep by recovering information from long-term memory as revealed by the mismatch negativity (MMN)Brain Res, 901 (2001), pp. 151-160
- Atienza et al., 2002aMismatch negativity (MMN): an objective measure of sensory memory and long-lasting memories during sleepInt J Psychophysiol, 46 (2002), pp. 215-225
- Atienza et al., 2002bThe time course of neural changes underlying auditory perceptual learningLearn Mem, 9 (2002), pp. 138-150
- Atienza et al., 2001Auditory information processing during human sleep as revealed by event-related brain potentialsClin Neurophysiol, 112 (2001), pp. 2031-2045
- Atienza et al., 1997The mismatch negativity component reveals the sensory memory during REM sleep in humansNeurosci Lett, 237 (1997), pp. 21-24
- Atienza et al., 2000Decay time of the auditory sensory memory trace during wakefulness and REM sleepPsychophysiology, 37 (2000), pp. 485-493
- Atienza et al., 2004Posttraining sleep enhances automaticity in perceptual discriminationJ Cogn Neurosci, 16 (2004), pp. 53-64
- Auer and Luce, 2003Probabilistic phonotactics in spoken word recognitionC.T. McLennan, P.A. Luce, G. Mauner, J. Charles-Luce (Eds.), Working papers on language and perception, University of Buffalo (2003), pp. 164-202
- Aulanko et al., 1993Phonetic invariance in the human auditory cortexNeuroReport, 4 (1993), pp. 1356-1358
- Baldeweg et al., 2004Mismatch negativity potentials and cognitive impairment in schizophreniaSchizophr Res, 69 (2004), pp. 203-217
- Baldeweg et al., 1999Differential changes in frontal and sub-temporal components of mismatch negativityInt J Psychophysiol, 33 (1999), pp. 143-148
- Baldeweg et al., 2006Nicotinic modulation of human auditory sensory memory: evidence from mismatch negativity potentialsInt J Psychophysiol, 59 (2006), pp. 49-58
- Baudena et al., 1995Intracerebral potentials to rare target and distractor auditory and visual stimuli.III. Frontal cortexElectroencephalogr Clin Neurophysiol, 94 (1995), pp. 251-264
- Bazana and Stelmack, 2002Intelligence and information processing during an auditory discrimination task with backward masking: an event-related potential analysisJ Pers Soc Psychol, 4 (2002), pp. 998-1008
- Beauchemin et al., 2006Electrophysiological markers of voice familiarityEur J Neurosci, 23 (2006), pp. 3081-3086
- Bernstein et al., 2002Visual speech perception without primary auditory cortex activationNeuroReport, 13 (2002), pp. 311-315
- Berti et al., 2004Bottom-up influences on working memory: behavioral and electrophysiological distraction varies with distractor strengthExp Psychol, 51 (2004), pp. 249-257
- Berti and Schröger, 2001A comparison of auditory and visual distraction effects: behavioral and event-related indicesCogn Brain Res, 11 (2001), pp. 265-273
- Berti et al., 2000Attentive and pre-attentive periodicity analysis in auditory memory: an event-related brain potential studyNeuroReport, 11 (2000), pp. 1883-1887
- Bertoli et al., 2001Mismatch negativity and psychoacoustic measures of gap detection in normally hearing subjectsPsychophysiology, 38 (2001), pp. 334-342
- Bertoli et al., 2002Temporal resolution in young and elderly subjects as measured by mismatch negativity and a psychoacoustic gap detection taskClin Neurophysiol, 113 (2002), pp. 396-406
- Besle et al., 2005Is the auditory sensory memory sensitive to visual information?Exp Brain Res, 166 (2005), pp. 337-344
- Bonte et al., 2005Auditory cortical tuning to statistical regularities in phonologyClin Neurophysiol, 116 (2005), pp. 2765-2774
- Born et al., 1987cInfluences of vasopressin and oxytocin on human event-related brain potentials in an attention taskJ Psychophysiol, 4 (1987), pp. 351-360
- Born et al., 1987bDose-dependent influences on electrophysiological signs of attention in humans after neuropeptide ACTH 4-10Exp Brain Res, 67 (1987), pp. 85-92
- Born et al., 1987aDose-dependent influences on ERP indicators of attention after neuropeptide ACTH 4-10Current Trends Event-Relat Potent Res, EEG Suppl. 40 (1987), pp. 509-513
- Born et al., 1986Vasopressin and electrophysiological signs of attention in manPeptides, 7 (1986), pp. 189-193
- Böttcher-Gandor and Ullsperger, 1992Mismatch negativity in event-related potentials o auditory stimuli as a function of varying interstimulus intervalPsychophysiology, 29 (1992), pp. 546-550
- Bradlow et al., 1999Effects of lengthened formant transition duration on discrimination and neural representation of synthetic CV syllables by normal and learning-disabled childrenJ Acoust Soc Am, 106 (1999), pp. 2086-2096
- Brattico et al., 2002aContext effects on pitch perception in musicians and non-musicians: evidence from ERP recordingsMusic Percept, 19 (2002), pp. 199-222
- Brattico et al., 2002bSimultaneous storage of two complex temporal sound patterns in auditory sensory memoryNeuroReport, 13 (2002), pp. 1747-1751
- Bregman, 1990Auditory scene analysis: the perceptual organization of soundBradford Books, Cambridge, MA (1990)
- Cacace and McFarland, 2003Quantifying signal-to-noise ratio of mismatch negativity in humansNeurosci Lett, 341 (2003), pp. 251-255
- Caclin et al., 2006Separate neural processing of timbre dimensions in auditory sensory memoryJ Cogn Neurosci, 18 (2006), pp. 1959-1972
- Campbell et al., 1991Evoked potential measures of information processing during natural sleepR. Broughton, R. Ogilvie (Eds.), Sleep, arousal and performance, Birkhauser, Cambridge, MA (1991), pp. 88-116
- Campbell and Colrain, 2002Event-related potential measures of the inhibition of information processing: II. The sleep onset periodInt J Psychophysiol, 46 (2002), pp. 19-214
- Campbell et al., 1988Campbell KB, McGarry PA, Bell I. Information processing during sleep: the effects of high stimulus intensity. In: Koella WP, Obál F, Schulz H, Visser P, editors, Sleep ’86. Stuttgart-New York: Gustav Fischer Verlag; 1988. p. 376–8.
- Carral et al., 2005A kind of auditory ’primitive intelligence’ already present at birthEur J Neurosci, 21 (2005), pp. 3201-3204
- Celsis et al., 1999Differential fMRI responses in the left posterior superior temporal gyrus and left supramarginal gyrus to habituation and change detection in syllables and tonesNeuroImage, 9 (1999), pp. 135-144
- Ceponiene et al., 2002Event-related potential features indexing central auditory discrimination by newbornsCogn Brain Res, 13 (2002), pp. 101-113
- Cheour et al., 1998Development of language-specific phoneme representations in the infant brainNature Neurosci, 1 (1998), pp. 351-353
- Cheour et al., 2002bThe auditory sensory memory trace decays rapidly in newbornsScand J Psychol, 43 (2002), pp. 33-39
- Cheour et al., 2002cElectric brain responses obtained from newborn infants to changes in duration in complex harmonic tonesDev Neurophysiol, 22 (2002), pp. 471-479
- Cheour et al., 2000Mismatch negativity (MMN) as a tool for investigating auditory discrimination and sensory memory in infants and childrenClin Neurophysiol, 111 (2000), pp. 4-16
- Cheour et al., 2002aSpeech sounds learned by sleeping newbornsNature, 415 (2002), pp. 599-600
- Cheour et al., 2002dMismatch negativity (MMN) shows that 3-6-years-old children can learn to discriminate non-native speech sounds within two monthsNeuroscience Letters, 325 (2002), pp. 187-190
- Colin et al., 2002aElectrophysiology of spatial scene analysis: the Mismatch Negativity (MMN) is sensitive to the ventriloquism illusionClin Neurophysiol, 113 (2002), pp. 507-518
- Colin et al., 2002bMismatch negativity evoked by the McGurk-MacDonald effect: evidence for a phonological representation within the auditory sensory short time memoryClin Neurophysiol, 113 (2002), pp. 495-506
- Colin et al., 2004aGeneralization of the generation of an MMN by illusory McGurk percepts: voiceless consonantsClin Neurophysiol, 115 (2004), pp. 1989-2000
- Colin et al., 2004bMismatch negativity evoked by the McGurk-MacDonald effect: a phonetic representation within short-term memoryClin Neurophysiol, 113 (2004), pp. 495-506
- Connolly and Phillips, 1994Event-related potential components reflect phonological and semantic processing of the terminal word spoken sentencesJournal of Cognitive Neuroscience, 6 (1994), pp. 256-266
- Connolly et al., 2001Phonological aspects of word recognition as revealed by high-resolution spatio-temporal brain mappingNeuroReport, 12 (2001), pp. 237-243
- Cooper et al., 2006Auditory sensory memory and the aging brain: a mismatch negativity studyNeurobiol Aging, 27 (2006), pp. 752-762
- Coslett et al., 2002Knowledge of the human body: a distinct semantic domainNeurology, 59 (2002), pp. 357-363
- Cowan, 1984On short and long auditory storesPsychol Bull, 96 (1984), pp. 341-370
- Cowan, 1988Evolving conceptions of memory storage, selective attention, and their mutual constraints within the human information-processing systemPsychol Bull, 104 (1988), pp. 163-191
- Cowan et al., 1993Memory prerequisites of the mismatch negativity in the auditory event-related potential (ERP)J Exp Psychol: Human Percept Perform, 19 (1993), pp. 909-921
- Csépe, 1995On the origin and development of the mismatch negativityEar Hear, 16 (1995), pp. 91-104
- Csépe et al., 1987Evoked potential correlates of stimulus deviance during wakefulness and sleep in cat - animal model of mismatch negativityElectroencephalogr Clin Neurophysiol, 66 (1987), pp. 571-578
- Csépe et al., 1988Csépe V, Karmos G, Molnár M. Evoked potential correlates of sensory mismatch process during sleep in cats. In: Koella, Obál, Schulz, Visser, editors, Sleep ’86. Stuttgart-New York: Gustav Fischer Verlag; 1988. p. 281–283.
- Csépe et al., 1989Subcortical evoked potential correlates of early information processing: mismatch negativity in catsE. Başar, T.H. Bullock (Eds.), Springer series in brain dynamics, vol. 2, Springer Verlag, Berlin (1989), pp. 278-289
- Csépe et al., 1992Evoked magnetic responses of the human auditory cortex to minor pitch changes: localization of the mismatch fieldElectroencephalogr Clin Neurophysiol, 84 (1992), pp. 538-548
- Csépe et al., 1997Mismatch field to tone pairs: neuromagnetic evidence for temporal integration at the sensory levelElectroencephalogr Clin Neurophysiol, 104 (1997), pp. 1-9
- Czigler, in pressCzigler I. Visual mismatch-negativity: violation of non-attended environmental regulations. J Psychophysiol, in press.
- Czigler et al., 2004Visual change detection: Event-related potentials are dependent on stimulus location in humansNeuroscience Letters, 364 (2004), pp. 149-153
- Czigler et al., 2002Memory-based detection of task-irrelevant visual changesPsychophysiology, 39 (2002), pp. 869-873
- Czigler et al., 1992Age and inter-stimulus interval effects on event-related potentials to frequent and infrequent auditory stimuliBiological Psychology, 33 (1992), pp. 195-206
- Czigler and Winkler, 1996Preattentive auditory change detection relies on unitary sensory memory representationsNeuroReport, 7 (1996), pp. 2413-2417
- Dalebout and Stack, 1999Mismatch negativity to acoustic differences not differentiated behaviorallyJ Am Acad Audiol, 10 (1999), pp. 388-399
- Daltrozzo et al., 2007Predicting coma and other low responsive patients outcome using event-related brain potentials: a meta-analysisClin Neurophysiol, 118 (2007), pp. 606-614
- D’Arcy et al., 2004Separating phonological and semantic processing in auditory sentence processing: a high-resolution event-related brain potential studyHuman Brain Mapping, 22 (2004), pp. 40-51
- Deacon et al., 2000Effect of frequency separation and stimulus rate on the mismatch negativity: an examination of the issue of refractoriness in humansNeurosci Lett, 287 (2000), pp. 167-170
- Deacon et al., 1998Automatic change detection: does the auditory system use representations of individual stimulus features or gestalts?Psychophysiology, 35 (1998), pp. 413-419
- Dehaene-Lambertz, 1997Electrophysiological correlates of categorical phoneme perception in adultsNeuroReport, 8 (1997), pp. 919-924
- Dehaene-Lambertz, 2000Cerebral specialization for speech and non-speech stimuli in infantsJ Cogn Neurosci, 12 (2000), pp. 449-460
- Dehaene-Lambertz and Baillet, 1998A phonological representation in the infant brainNeuroReport, 9 (1998), pp. 1885-1888
- Dehaene-Lambertz and Dehaene, 1994Speed and cerebral correlates of syllable discrimination in infantsNature, 370 (1994), pp. 292-294
- Dehaene-Lambertz et al., 2000Electrophysiological correlates of phonological processing: a cross-linguistic studyJ Cogn Neurosci, 12 (2000), pp. 635-647
- Dehaene-Lambertz and Gliga, 2004Common neural basis for phoneme processing in infants and adultsJ Cogn Neurosci, 16 (2004), pp. 1375-1387
- Dehaene-Lambertz and Pena, 2001Electrophysiological evidence for automatic phonetic processing in neonatesNeuroReport, 12 (2001), pp. 3155-3158
- Deouell and Bentin, 1998Variable cerebral responses to equally distinct deviance in four auditory dimensions: a mismatch negativity studyPsychophysiology, 35 (1998), pp. 745-754
- Deouell et al., 1998Mismatch negativity in dichotic listening: evidence for interhemispheric differences and multiple generatorsPsychophysiology, 35 (1998), pp. 355-365
- Deouell et al., 2003Spatial asymmetries of auditory event-synthesis in humansNeurosci Lett, 335 (2003), pp. 171-174
- Deouell et al., 2006Spatial location is accurately tracked by human auditory sensory memory: evidence from the mismatch negativityEuropean Journal of Neuroscience, 24 (2006), pp. 1488-1494
- Desjardins et al., 1999Using mismatch negativity to measure auditory temporal resolution thresholdsNeuroReport, 10 (1999), pp. 2079-2082
- Diesch et al., 1998The magnetic mismatch field elicited by words and phonological non-wordsNeuroReport, 9 (1998), pp. 455-460
- Diesch and Luce, 1997Magnetic mismatch fields elicited by vowels and consonantsExp Brain Res, 116 (1997), pp. 139-152
- Dittmann-Balcar et al., 2001Dorsolateral prefrontal cortex activation during automatic auditory duration-mismatch processing in humans: a positron emission tomography studyNeurosci Lett, 308 (2001), pp. 119-122
- Dittmann-Balcar et al., 1999Attention-dependent allocation of auditory processing resources as measured by mismatch negativityNeuroReport, 10 (1999), pp. 3749-3753
- Doeller et al., 2003Prefrontal cortex involvement in preattentive auditory deviance detection: neuroimaging and electrophysiological evidenceNeuroImage, 20 (2003), pp. 1270-1282
- Donald and Young, 1982The time course of selective neural tuning in auditory attentionExp Brain Res, 46 (1982), pp. 357-367
- Donchin, 1981Surprise! Surprise?Psychophysiology, 18 (1981), pp. 493-513
- Donchin and Coles, 1988Is the P300 component a manifestation of context updating?Behav Brain Sci, 11 (1988), pp. 355-425
- Donchin and Coles, 1991Behavior, cognition and event-related brain potentialsBehav Brain Sci, 14 (1991), pp. 735-739
- Downar et al., 2000A multimodal cortical network for the detection of changes in the sensory environmentNature Neurosci, 3 (2000), pp. 277-283
- Draganova et al., 2005Sound frequency change detection in fetuses and newborns, a magnetoencephalographic studyNeuroImage, 28 (2005), pp. 354-361
- Duncan and Keye, 1987Effects of clonidine on event-related potential measures of information processingR. Johnson Jr., J.W. Rohrbaugh, R. Parasuraman (Eds.), Current trends in event-related potential research, Elsevier, Amsterdam (1987), pp. 527-531(Supplement 40 to Electroencephalography and clinical Neurophysiology)
- Dyson et al., 2005Effects of visual attentional loads on low-level auditory scene analysisCogn, Affect, Behav Neurosci, 5 (2005), pp. 319-338
- Endrass et al., 2004Enhanced mismatch negativity brain response after binaural word presentationEur J Neurosci, 19 (2004), pp. 1653-1660
- Eriksson and Villa, 2005Event-related potentials in an auditory oddball situation in the ratBioSystems, 79 (2005), pp. 207-212
- Escera et al., 2000aInvoluntary attention and distractibility as evaluated with event-related brain potentialsAudiol Neuro-Otol, 5 (2000), pp. 151-166
- Escera et al., 1998Neural mechanisms of involuntary attention switching to novelty and change in the acoustic environmentJ Cogn Neurosci, 10 (1998), pp. 590-604
- Escera and Grau, 1996Short-term replicability of the mismatch negativityElectroencephalogr Clin Neurophysiol, 100 (1996), pp. 549-554
- Escera et al., 2001Electrical responses reveal the temporal dynamics of brain events during involuntary attention switchingEur J Neurosci, 14 (2001), pp. 877-883
- Escera et al., 2003Attention capture by auditory significant stimuli: semantic analysis follows attention switchingEur J Neurosci, 18 (2003), pp. 2408-2412
- Escera et al., 1999The individual replicability of mismatch negativity at short and long interstimulus intervalsClin Neurophysiol, 110 (1999), pp. 1-6
- Eulitz and Lahiri, 2004Neurobiological evidence for abstract phonological representations in the mental lexicon during speech recognitionJ Cogn Neurosci, 16 (2004), pp. 577-583
- Fischer et al., 2004Predictive value of sensory and cognitive evoked potentials for awakening from comaNeurology, 63 (2004), pp. 669-673
- Fischer et al., 2006Improved prediction of awakening or nonawakening from severe anoxic coma using tree-based classification analysisCrit Care Med, 34 (2006), pp. 1-5
- Fischer et al., 1999Mismatch negativity and late auditory evoked potentials in comatose patientsClinical Neurophysiology, 110 (1999), pp. 1601-1610
- Ford and Hillyard, 1981Event-related potentials (ERPs) to interruptions of a steady rhythmPsychophysiology, 18 (1981), pp. 322-330
- Ford et al., 1976Attention effects on auditory evoked potentials to infrequent eventsBiol Psychol, 4 (1976), pp. 65-77
- Foxe and Schroeder, 2005The case for feedforward multisensory convergence during early cortical processingNeuroReport, 16 (2005), pp. 419-423
- Foyle and Watson, 1984Stimulus-based versus performance-based measurement of auditory backward recognition maskingPercept Psychophys, 36 (1984), pp. 515-522
- Frazier and Clifton, 1996ConstrualMIT Press, Cambridge, MA (1996)
- Friedman et al., 2001The novelty P3: an event-related brain potential (ERP) sign of the brain’s evaluation of noveltyNeurosci Biobehav Rev, 25 (2001), pp. 355-373
- Friederici et al., 2002Neural manifestation of cognitive and precognitive mismatch detection in early infancyNeuroReport, 13 (2002), pp. 1251-1254
- Friederici et al., 1996Temporal structure of syntactic parsing: early and late event-related brain potential effects elicited by syntactic anomaliesJ Exp Psychol: Learn, Mem, Cogn, 22 (1996), pp. 1219-1248
- Friederici et al., 1999Event-related brain potentials during natural speech processing: effects of semantic, morphologic and syntactic violationsCogn Brain Res, 1 (1999), pp. 183-192
- Friederici et al., 1993Event-related brain potentials during natural speech processing: effects of semantic, morphological and syntactic violationsCogn Brain Res, 1 (1993), pp. 183-192
- Friederici et al., 2000lLocalizing of early syntactic processes in frontal and temporal cortical areas: a magnetoencephalographic studyHuman Brain Map, 11 (2000), pp. 1-11
- Friston, 2005A theory of cortical responsesProc R Soc Lond Biol Sci, 360 (2005), pp. 815-836
- Frodl-Bauch et al., 1997Dipole localization and test-retest reliability of frequency and duration mismatch negativity generator processesBrain Topogr, 10 (1997), pp. 3-8
- Fu et al., 2003Event-related potentials reveal involuntary processing of orientation changes in the visual modalityPsychophysiology, 40 (2003), pp. 770-775
- Fujioka et al., 2004Musical training enhances automatic encoding of melodic contour and interval structureJ Cogn Neurosci, 16 (2004), pp. 1010-1021
- Fujioka et al., 2005Automatic encoding of polyphonic melodies in musicians and nonmusiciansJ Cogn Neurosci, 17 (2005), pp. 1578-1592
- Fuster, 1989The prefrontal cortex: anatomy, physiology, and neuropsychology of the frontal lobeRaven, New York (1989)
- Gaeta et al., 1998An event-related potential study of age-related changes in sensitivity to stimulus devianceNeurobiol Aging, 19 (1998), pp. 447-459
- Gaeta et al., 2002Age-related changes in neural trace generation of rule-based auditory featuresNeurobiol Aging, 23 (2002), pp. 443-455
- Garnsey et al., 1997The contributions of verb bias and plausibility to the comprehension of temporarily ambiguous sentencesJ Mem Lang, 37 (1997), pp. 58-93
- Giard et al., 1995Separate representation of stimulus frequency, intensity, and duration in auditory sensory memoryJ Cogn Neurosci, 7 (1995), pp. 133-143
- Giard and Peronnet, 1999Auditory–visual integration during multimodal object recognition in humans: a behavioral and electrophysiological studyJ Cogn Neurosci, 11 (1999), pp. 473-490
- Giard et al., 1990Brain generators implicated in processing of auditory stimulus deviance: a topographic event-related potential studyPsychophysiology, 27 (1990), pp. 627-640
- Gomes et al., 1997Storage of feature conjunctions in transient auditory memoryPsychophysiology, 34 (1997), pp. 712-716
- Gomes et al., 1995The nature of preattentive storage in the auditory systemJ Cogn Neurosci, 7 (1995), pp. 81-94
- Gomes et al., 1999Electrophysiological evidence of developmental changes in the duration of auditory sensory memoryDev Psychol, 35 (1999), pp. 294-302
- Gomot et al., 2000Maturation of frontal and temporal components of mismatch negativity (MMN) in childrenNeuroReport, 11 (2000), pp. 3109-3112
- Gootjes et al., 1999Left-hemisphere dominance for processing of vowels: a whole-scalp neuromagnetic studyNeuroReport (1999), pp. 2987-2991
- Gottselig et al., 2004Human central auditory plasticity associated with tone sequence learningLearn Mem, 11 (2004), pp. 162-171
- Goydke et al., 2004Changes in emotional tone and instrumental timbre are reflected by the mismatch negativityCogn Brain Res, 21 (2004), pp. 259-351
- Grau et al., 1998Mismatch negativity and sensory memory evaluation: a new faster paradigmNeuroReport, 9 (1998), pp. 2451-2456
- Grau et al., 2001Auditory sensory memory as indicated by mismatch negativity in chronic alcoholismClin Neurophysiol, 112 (2001), pp. 728-731
- Grimm et al., 2004Differential processing of duration changes within short and long sounds in humansNeurosci Lett, 356 (2004), pp. 83-86
- Groenen et al., 1996On the clinical relevance of mismatch negativity: results from subjects with normal hearing and cochlear implant usersAudiol Neuro-Otol, 1 (1996), pp. 112-124
- Gumenyuk et al., 2003Electric brain responses indicate preattentive processing of abstract acoustic regularities in childrenNeuroReport, 14 (2003), pp. 1411-1415
- Gunter et al., 2000Syntactic gender and semantic expectancy: ERPs reveal early autonomy and late interactionJ Cogn Neurosci, 12 (2000), pp. 556-568
- Ha et al., 2003Optimized individual mismatch negativity sourcelocalization using a realistic head model and the Talairach coordinate systemBrain Topography, 15 (2003), pp. 233-238
- Haenschel et al., 2005Event-related brain potential correlates of human auditory sensory memory-trace formationJ Neurosci, 25 (2005), pp. 10494-10501
- Hagoort and Brown, 2000ERP effects of listening to speech: semantic ERP effectsNeuropsychologia, 38 (2000), pp. 1518-1530
- Hahne and Friederici, 1999Electrophysiological evidence for two steps in syntactic analysis: early automatic and late controlled processesJ Cogn Neurosci, 11 (1999), pp. 194-205
- Halgren et al., 1995Intracerebral potentials to rare target and distractor auditory and visual stimuli: I. Superior temporal plane and parietal lobeElectroencephalogr Clin Neurophysiol, 94 (1995), pp. 191-220
- Halgren et al., 1998Generators of the late cognitive potentials in auditory and visual oddball tasksElectroencephalogr Clin Neurophysiol, 106 (1998), pp. 156-164
- Hansen and Hillyard, 1983Selective attention to multimensional auditory stimuliJ Exp Psychol Hum Percept Perform, 9 (1983), pp. 1-19
- Hansen and Hillyard, 1988Temporal dynamics of human auditory selective attentionPsychophysiology, 25 (1988), pp. 316-329
- Hari et al., 1984Responses of the primary auditory cortex to pitch changes in a sequence of tone pips: neuromagnetic recordings in manNeurosci Lett, 50 (1984), pp. 127-132
- Hari et al., 1989bSelective listening modifies activity of the human auditory cortexExp Brain Res, 74 (1989), pp. 463-470
- Hari et al., 1989aNeuromagnetic responses of human auditory cortex to interruptions in a steady rhythmNeurosci Lett, 99 (1989), pp. 164-168
- Hari et al., 1992Neuromagnetic mismatch fields to single and paired tonesElectroencephalogr Clin Neurophysiol, 82 (1992), pp. 152-154
- Harmony et al., 2000Primary task demands modulate P3a amplitudeCogn Brain Res, 9 (2000), pp. 53-60
- Hauk et al., 2006The sound of actions as reflected by mismatch negativity: rapid activation of cortical sensory-motor networks by sounds associated with finger and tongue movementsEuropean Journal of Neuroscience, 23 (2006), pp. 811-821
- Hawkins and Presson, 1977Masking and pereptual selectivity in auditory recognitionS. Dornic (Ed.), Attention and performance, vol. VI, Erlbaum, Hillsdale, NJ (1977), pp. 195-211
- Hawkins and Presson, 1986Auditory information processingK.R. Boff, L. Kaufman, J.P. Thomas (Eds.), Handbook of perception and human performance, vol. 2, Wiley, New York (1986), pp. 261-264
- Heinke and Koelsch, 2005The effects of anesthetics on brain activity and cognitive functionCurr Opin Anaesthesiol, 18 (2005), pp. 625-631
- Heinke et al., 2004Sequential effects of increasing propofol sedation on frontal and temporal cortices as indexed by auditory event-related potentialsAnesthesiology, 100 (2004), pp. 617-625
- Heslenfeld, 2003Visual mismatch negativityJ. Polich (Ed.), Detection of change: event-related potential and fMRI findings, Kluwer Academic Publishers, Boston (2003)
- Hillyard et al., 1973Electrical signs of selective attention in the human brainScience, 182 (1973), pp. 177-180
- Honbolygó et al., 2004Suprasegmental speech cues are automatically processed by the human brain: a mismatch negativity studyNeurosci Lett, 363 (2004), pp. 84-88
- Hoppe et al., 1996Auditory evoked potentials during speech perceptionB. Kollmeier (Ed.), Psychoacoustics, speech, and hearing aids, World Scientific, Singapore (1996), pp. 133-136
- Horváth et al., 2001Simultaneously active pre-attentive representations of local and global rules for sound sequences in the human brainCogn Brain Res, 12 (2001), pp. 131-144
- Hugdahl, 2002Dichotic listening in the study of auditory lateralityK. Hugdahl, R.J. Davidson (Eds.), Assym brain, MIT Press, Cambridge, MA (2002), pp. 441-477
- Huotilainen et al., 1993Interaction between representations of different features of auditory sensory memoryNeuroReport, 4 (1993), pp. 1279-1281
- Huotilainen et al., 2005Short-term memory functions of the human fetus recorded with magnetoencephalographyNeuroReport, 16 (2005), pp. 81-84
- Ikeda et al., 2002Phonetically determined asymmetry of the mismatch negativity in JapaneseInt Cong Ser, 1232 (2002), pp. 59-62
- Ilvonen et al., 2001The processing of sound duration after left hemisphere stroke: event-related potential and behavioral evidencePsychophysiology, 38 (2001), pp. 622-628
- Ilvonen et al., 2003Auditory discrimination after left hemisphere stroke: an MMN follow-up studyStroke., 34 (2003), pp. 1746-1753
- Imada et al., 1993aImada T, Fukuda K, Kawakatsu M, Masjiko T, Odaka K, Hayashi M, et al. Mismatch fields evoked by a rhythm passage. In: Deecke L, Baumgartner C, Stroink G, Williamson SJ, editors, Advances in biomagnetism. Vienna: 9th International Conference on Biomagnetism; 1993a. p. 118–9.
- Imada et al., 1993bDeterminants of the auditory mismatch responseElectroencephalography & clinical Neurophysiology, 87 (1993), pp. 144-153
- Jääskeläinen et al., 1996aEffects of ethanol and auditory distraction on forced choice reaction timeAlcohol, 13 (1996), pp. 153-156
- Jääskeläinen et al., 1999bTemporal span of auditory sensory memory and mismatch negativity: revisitedNeuroReport, 10 (1999), pp. 1305-1308
- Jääskeläinen et al., 1996bEffect of acute ethanol on auditory and visual event-related potentials: A review and reinterpretationBiological Psychiatry, 40 (1996), pp. 284-291
- Jääskeläinen et al., 1996cMismatch negativity subcomponents and ethyl alcoholBiol Psychol, 43 (1996), pp. 13-25
- Jääskeläinen et al., 1999aDecay of cortical pre-attentive sound discrimination in middle-ageNeuroReport, 10 (1999), pp. 123-126
- Jacobsen et al., 2003aPreattentive memory-based comparison of sound intensityAudiology & Neuro-Otology, 8 (2003), pp. 338-346
- Jacobsen et al., 2004aPre-attentive auditory processing of lexicalityBrain Lang, 88 (2004), pp. 54-67
- Jacobsen et al., 2004bPre-attentive perception of vowel phonemes from variable speech stimuliPsychophysiology, 14 (2004), pp. 654-659
- Jacobsen et al., 2003bMismatch negativity to pitch change: Varied stimulus proportions in controlling effects of neural refractoriness on human auditory event-related potentialsNeuroscience Letters, 344 (2003), pp. 79-82
- Jacobsen et al., 2005Familiarity affects the processing of task-irrelevant auditory devianceJ Cogn Neurosci, 17 (2005), pp. 1704-1713
- Jacobsen and Schröger, 2001Is there pre-attentive memory-based comparison of pitch?Psychophysiology, 38 (2001), pp. 723-727
- Jacobsen and Schröger, 2003Measuring duration mismatch negativityClin Neurophysiol, 114 (2003), pp. 1133-1143
- Jankowiak and Berti, 2007Behavioral and event-related potential distraction effects with regularly occurring auditory deviantsPsychophysiology, 44 (2007), pp. 79-85
- Jaramillo et al., 1999An event-related potential (ERP) study of duration changes in speech and non-speech soundsNeuroReport, 10 (1999), pp. 3301-3305
- Jaramillo et al., 2000Mismatch negativity and behavioural discrimination in humans as a function of the magnitude of change in sound durationNeurosci Lett, 290 (2000), pp. 101-104
- Javitt et al., 1998Impaired mismatch negativity (MMN) generation in schizophrenia as a function of stimulus deviance, probability, and interstimulus/interdeviant intervalElectroencephalogr Clin Neurophysiol, 108 (1998), pp. 143-153
- Javitt et al., 1992Demonstration of mismatch negativity in the monkeyElectroencephalogr Clin Neurophysiol, 83 (1992), pp. 87-90
- Javitt et al., 1996Role of cortical N-methyl-d-aspartate receptors in auditory sensory memory and mismatch negativity generation: implications for schizophreniaProc Natl Acad Sci USA, 93 (1996), pp. 11962-11967
- Jemel et al., 2002Mismatch negativity results from bilateral asymmetric dipole sources in the frontal and temporal lobesBrain Topogr, 15 (2002), pp. 13-27
- Jones and Perez, 2002The auditory C-process of spectral profile analysisClin Neurophysiol, 113 (2002), pp. 1558-1565
- Jones et al., 2000Spectro-temporal analysis of complex tones: two cortical processes dependent on retention of sounds in the long auditory storeClinical Neurophysiology, 111 (2000), pp. 1569-1576
- Joutsiniemi et al., 1998The mismatch negativity for duration decrement of auditory stimuli in healthy subjectsElectroencephalogr Clin Neurophysiol, 108 (1998), pp. 154-159
- Kähkönen and Ahveninen, 2002Combination of magneto- and electroencephalograhy in studies of monoamine modulation on attentionMethods Find Exp Clin Pharmacol, 24 (Suppl. C) (2002), pp. 27-34
- Kaernbach et al., 1998Human event-related brain potentials to auditory periodic noise stimuliNeurosci Lett, 242 (1998), pp. 17-20
- Kähkönen et al., 2002Dopamine modulates involuntary attention shifting and reorienting. An electromagnetic studyClin Neurophysiol, 113 (2002), pp. 1894-1902
- Kähkönen et al., 2005Serotonergic modulation of mismatch negativityPsychiatry Res: Neuroimag, 138 (2005), pp. 61-74
- Kaiser and Lutzenberger, 2001Location changes enhance hemispheric asymmetry of magnetic fields evoked by lateralized sounds in humansNeurosci Lett, 314 (2001), pp. 17-20
- Kaiser et al., 2000aSimultaneous bilateral mismatch response to right- but not leftward sound lateralizationNeuroReport, 11 (2000), pp. 2889-2892
- Kaiser et al., 2000bRight-hemisphere dominance for the processing of sound-source lateralizationJ Neurosci, 20 (2000), pp. 6631-6639
- Kane et al., 1993Electrophysiological indicator of avakening from comaLancet, 341 (1993), p. 668
- Kane et al., 1996Event-related potentials-neurophysiological tools predicting emergence and early outcome from traumatic comaIntensive Care Med, 22 (1996), pp. 39-46
- Karis et al., 1984P300 and memory: individual differences in the von Restorff effectCogn Psychol, 16 (1984), pp. 177-216
- Kasai et al., 1999Multiple generators in the auditory automatic discrimination process in humansNeuroReport, 10 (1999), pp. 2267-2271
- Kasai et al., 2001Brain laternalization for mismatch response to across- and within-category change of vowelsNeuroReport, 12 (2001), pp. 2467-2471
- Kathmann et al., 1999Stability of the mismatch negativity under different stimulus and attention conditionsClin Neurophysiol, 110 (1999), pp. 317-323
- Kaukoranta et al., 1989Reactions of human auditory cortex to changes in tone durationHear Res, 41 (1989), pp. 15-22
- Kayser et al., 1998Dissociation of brain ERP topographies for tonal and phonetic oddball tasksPsychophysiology, 35 (1998), pp. 576-590
- Kekoni et al., 1997Rate effect and mismatch responses in the somatosensory system: ERP-recordings in humansBiol Psychol, 46 (1997), pp. 125-142
- Kelly et al., 2005Electrophysiological and speech perception measures of auditory processing in experienced adult cochlear implant usersClin Neurophysiol, 116 (2005), pp. 1235-1246
- Kenemans et al., 2003Detection of visual change: mismatch or rareness?NeuroReport, 14 (2003), pp. 1239-1242
- Kimura et al., 2005Positive difference in ERPs reflects independent processing of visual changesPsychophysiology, 42 (2005), pp. 369-379
- King et al., 1995Acoustic features and acoustic change are represented by different central pathwaysHear Res, 85 (1995), pp. 45-52
- Kircher et al., 2004Mismatch negativity responses in schizophrenia: a combined fMRI and whole-head MEG studyAm J Psychiatry, 161 (2004), pp. 294-304
- Kisley et al., 2004Comparison of sensory gating to mismatch negativity and self-reported perceptual phenomena in healthy adultsPsychophysiology, 41 (2004), pp. 604-612
- Knight, 1996Contribution of human hippocampal region to novelty detectionNature, 383 (1996), pp. 256-259
- Koelsch et al., 1999Superior pre-attentive auditory processing in musiciansNeuroReport, 10 (1999), pp. 1309-1313
- Koelsch et al., 2000Brain indices of music processing: “Nonmusicians” are musicalJ Cogn Neurosci, 13 (2000), pp. 520-541
- Koelsch et al., 2002Effects of musical expertice on the early right anterior negativity: an event-related brain potential studyPsychophysiology, 39 (2002), pp. 657-663
- Koelsch et al., 2003aProcessing tonal modulations: an ERP studyJ Cogn Neurosci, 15 (2003), pp. 1149-1159
- Koelsch et al., 2003bChildren processing music: electric brain responses reveal musical competence and gender differencesJ Cogn Neurosci, 15 (2003), pp. 683-693
- Koelsch et al., 2004Music perception in cochlear implant users: an event-related potential studyClin Neurophysiol, 115 (2004), pp. 966-972
- Koelsch and Siebel, 2005Towards a neural basis of music perceptionTrends Cogn Sci, 9 (2005), pp. 578-584
- Koelsch et al., 2006Auditory processing during deep propofol sedation and recovery from unconsciousnessClin Neurophysiol, 117 (2006), pp. 1746-1759
- Kok, 2000Age-related changes in involuntary and voluntary attention as reflected in components of the event-related potential (ERP)Biol Psychol, 54 (2000), pp. 107-143
- Korpilahti et al., 2001Early and late mismatch negativity elicited by words and speech-like stimuli in childrenBrain Lang, 76 (2001), pp. 332-339
- Korzyukov et al., 1999Electromagnetic responses of the human auditory cortex generated by sensory-memory based processing of tone-frequency changesNeurosci Lett, 276 (1999), pp. 169-172
- Korzyukov et al., 2003Processing abstract auditory features in the human auditory cortexNeuroImage, 20 (2003), pp. 2245-2258
- Kozou et al., 2005The effect of different noise types on the speech and non-speech elicited mismatch negativityHear Res, 199 (2005), pp. 31-39
- Koyama et al., 2000aHemispheric lateralization in an analysis of speech sounds Left hemisphere dominance replicated in Japanese subjectsCognitive Brain Research, 10 (2000), pp. 119-124
- Koyama et al., 2000bThe masking effect in foreign speech sounds perception revealed by neuromagnetic responsesNeuroReport, 11 (2000), pp. 3765-4769
- Koyama et al., 2000bThe mask effect in foreign speech sounds perception revealed by neuromagnetic responsesNeuroReport, 11 (2000), pp. 3765-3769
- Kramer et al., 1995Assessment of mental workload with task-irrelevant auditory probesBiol Psychol, 40 (1995), pp. 83-100
- Krauel et al., 1999Is there a mismatch negativity analogue in the olfactory event-related potential?J Psychophysiol, 13 (1999), pp. 49-55
- Kraus et al., 1999Speech-sound discrimination in school-age children: psychophysical and neurophysiologic measuresJ Speech, Lang, Hear Res, 42 (1999), pp. 1042-1060
- Kraus and Cheour, 2000Speech sound representations in the brainAudiol Neuro-Otol, 5 (2000), pp. 140-150
- Kraus et al., 1994aDiscrimination of speech-like contrasts in the auditory thalamus and cortexJ Acoust Soc Am, 96 (1994), pp. 2758-2768
- Kraus et al., 1996Auditory neurophysiologic response and discrimination deficits in children with learning problemsScience, 273 (1996), pp. 971-973
- Kraus et al., 1995Central auditory plasticity associated with speech discrimination trainingJ Cogn Neurosci, 7 (1995), pp. 25-32
- Kraus et al., 1994bNonprimary auditory thalamic representation of acoustic changeJ Neurophysiol, 72 (1994), pp. 1270-1277
- Kraus et al., 1993aMismatch negativity in school-age children to speech stimuli are just perceptibly differentElectroencephalogr Clin Neurophysiol, 88 (1993), pp. 123-130
- Kraus et al., 1993bThe mismatch negativity cortical evoked potential elicited by speech in cochlear-implant usersHear Res, 65 (1993), pp. 118-124
- Kraus et al., 1992Mismatch negativity event-related potential elicited by speech stimuliEar Hear, 13 (1992), pp. 158-164
- Kropotov et al., 2000Human auditory-cortex mechanisms of preattentive sound discriminationNeurosci Lett, 280 (2000), pp. 87-90
- Kropotov et al., 1995Mismatch negativity to auditory stimulus change recorded directly from the human temporal cortexPsychophysiology, 32 (1995), pp. 418-422
- Kuhl, 1991Human adults and infants show a “perceptual magnet effect” for the prototypes of speech cathegories, monkeys do notPercept Psychophys, 50 (1991), pp. 93-107
- Kuhl, 2004Early language acquisition: cracking the speech codeNature Rev/ Neurosci, 5 (2004), pp. 831-843
- Kujala et al., 1992Neural plasticity in processing of sound location by the early blind: an event-related potential studyElectroencephalography and clinical Neurophysiology, 84 (1992), pp. 469-472
- Kujala et al., 2004Activation in the anterior left auditory cortex associated with phonological analysis of speech input: localization of the phonological mismatch negativity response with MEGCognitive Brain Research, 21 (2004), pp. 106-113
- Kujala et al., 2003Plastic cortical changes induced by learning to communicate with non-speech soundsNeuroReport, 14 (2003), pp. 1683-1687
- Kujala et al., 2000Basic auditory dysfunction in dyslexia as demonstrated by brain-activity measurementsPsychophysiology, Special Report, 37 (2000), pp. 262-266
- Kujala et al., 2001aThe mismatch negativity as an index of temporal processing in auditionClin Neurophysiol, 112 (2001), pp. 1712-1719
- Kujala et al., 2001bPlastic neural changes and reading improvement caused by audio–visual training in reading-impaired childrenProc Natl Acad Sci, 98 (2001), pp. 10509-10514
- Kurtzberg et al., 1995Developmental stdies and clinical application of mismatch negativity: problems and prospectsEar Hear, 16 (1995), pp. 105-117
- Kushnerenko et al., 2001Central auditory processing of durational changes in complex speech patterns by newborns: an event-related brain potential studyDev Neuropsychol, 19 (2001), pp. 83-97
- Kutas and Hillyard, 1980Reading senseless sentences: Brain potentials reflect semantic incongruityScience, 207 (1980), pp. 203-205
- Kutas and Hillyard, 1984Brain potentials during reading reflect word expectancy and semantic associationNature, 307 (1984), pp. 161-163
- Kwon et al., 2002Temporal association of MMN multiple generators: high density recording (128 channels)Int Cong Ser, 1232 (2002), pp. 335-338
- Lang et al., 1995Practical issues in the clinical application of mismatch negativityEar and Hearing, 16 (1995), pp. 118-130
- Lang et al., 1990Pitch discrimination performance and auditory event-related potentialsC.H.M. Brunia, A.W.K. Gaillard, A. Kok, G. Mulder, M.N. Verbaten (Eds.), Psychophysiological brain research, vol. 1, Tilburg University Press, Tilburg, the Netherlands (1990), pp. 294-298
- Laufer and Pratt, 2005The ‘F-complex’ and MMN tap different aspects of devianceClin Neurophysiol, 116 (2005), pp. 336-352
- Lavikainen et al., 1995Pitch change of a continous tone activates two distinct processes in human auditory cortex: a study with whole-head magnetometerElectroencephalogr Clin Neurophysiol, 96 (1995), pp. 93-96
- Lazar and Metherate, 2003Spectral interactions, but no mismatch negativity, in auditory cortex of anesthetized ratHear Res, 181 (2003), pp. 51-56
- Leino et al., 2007Representation of harmony rules in the human brain: Further evidence from event-related potentialsBrain Research, 1142 (2007), pp. 169-177
- Leppänen et al., 2004Maturational effects on newborn ERPs measured in the mismatch negativity paradigmExp Neurol, 190 (2004), pp. S91-S101
- Leppänen and Lyytinen, 1997Auditory event-related potentials in the study of developmental language related disordesAudiol Neuro-otol, 2 (1997), pp. 308-340
- Leppänen et al., 2002Brain responses to changes in speech sound durations differ between infants with and without familial risk for dyslexiaDev Neuropsychol, 22 (2002), pp. 407-422
- Levänen et al., 1996Deviant auditory stimuli activate human left and right auditory cortex differentlyCereb Cortex, 6 (1996), pp. 288-296
- Levänen et al., 1993Responses of the human auditory cortex to changes in one versus two stimulus featuresExp Brain Res, 97 (1993), pp. 177-183
- Levänen and Sams, 1997Disrupting human auditory change detection: Chopin is superior to white noisePsychophysiology, 34 (1997), pp. 258-265
- Liasis et al., 2000aIntracranial evidence for differential encoding of frequency and duration discrimination responsesEar Hear, 21 (2000), pp. 252-256
- Liasis et al., 2001Intracranial identification of an electric frontal-cortex response to auditory stimulus change: a case studyCogn Brain Res, 11 (2001), pp. 227-233
- Liasis et al., 1999Intracranial auditory detection and discrimination potentials as substrates of echoic memory in childrenCogn Brain Res, 7 (1999), pp. 503-506
- Liasis et al., 2000bIntracranial evidence for differential encoding of frequency and duration discrimination responsesEar Hear, 21 (2000), pp. 252-256
- Liebenthal et al., 2003Simultaneous ERP and fMRI of the auditory cortex in a passive oddball paradigmNeuroImage, 19 (2003), pp. 1395-1404
- Liberman and Whalen, 2000On the relation of speech to languageTrends Cogn Sci, 4 (2000), pp. 187-196
- Lonka et al., 2004The mismatch negativity (MMN) brain response as an index of speech perception recovery in cochlear-implant recipientsAudiol Neuro-otol, 9 (2004), pp. 160-162
- Lopez et al., 2003Musicians versus nonmusicians. A neurophysiological approachAnn N Y Acad Sci, 999 (2003), pp. 124-130
- Loui et al., 2005Effects of attention on the neural processing of harmonic syntax in Western musicCogn Brain Res, 25 (2005), pp. 678-687
- Lounasmaa et al., 1989Multi-SQUID recordings of human cerebral magnetic fields may give information about memory processesEurophys Lett, 9 (1989), pp. 603-608
- Loveless et al., 1996Temporal integration in auditory sensory memory: neuromagnetic evidenceElectroencephalogr Clin Neurophysiol, 100 (1996), pp. 220-228
- Loveless et al., 1994Human auditory cortical mechanisms of sound lateralization: Monaural and binaural shift responsesHear Res, 81 (1994), pp. 91-99
- Luauté et al., 2005Late auditory event-related potentials can be useful to predict good functional outcome after comaArch Phys Med Rehabil, 86 (2005), pp. 917-923
- Lyytinen et al., 1992Event-related potentials and autonomic responses to a change in unattended auditory stimuliPsychophysiology, 29 (1992), pp. 523-534
- Maekawa et al., 2005Functional characterization of mismatch negativity to a visual stimulusClin Neurophysiol, 116 (2005), pp. 2392-2402
- Maess et al., 2001Musical syntax is processed in Broca’s area: an MEG studyNature Neurosci, 4 (2001), pp. 540-545
- Maiste et al., 1995Event-related potentials and the categorical perception of speech soundsEar Hear, 16 (1995), pp. 68-90
- Mäkelä et al., 1998Modification of neuromagnetic signals by thalamic infarctionsElectroencephalogr Clin Neurophysiol, 106 (1998), pp. 433-443
- Mäntysalo and Näätänen, 1987The duration of a neuronal trace of an auditory stimulus as indicated by event-related potentialsBiol Psychol, 24 (1987), pp. 183-195
- Mäntysalo and Salmi, 1989Effect of noise on the mismatch negativity of the event-related potential of the human brainN.W. Bond, D.A.T. Siddle (Eds.), Psychobiology: issues and applications, Elsevier Science Publishers B.V., North Holland (1989), pp. 277-288
- Marco-Pallares et al., 2005Combined ICA-LORETA analysis of mismatch negativityNeuroImage, 25 (2005), pp. 471-477
- Marslen-Wilson, 1987Functional parallelism in spoken word-recognitionCognition, 25 (1987), pp. 71-102
- Marslen-Wilson and Tyler, 1975Processing structure of sentence perceptionNature, 257 (1975), pp. 784-786
- Martin and Boothroyd, 1999Cortical, auditory, event-related potentials in response to periodic and aperiodic stimuli with the same spectral envelopeEar Hear, 20 (1999), pp. 33-44
- Martin and Chao, 2001Semantic memory and the brain: structure and processesCurr Opin Neurobiol, 11 (2001), pp. 194-201
- Martin et al., 1999The effect of decreased audibility produced by high-pass noise masking on N1 and the mismatch negativity to speech sounds /ba/ and /da/J Speech, Lang, Hear Res, 42 (1999), pp. 271-286
- Martin et al., 1997The effects of decreased audibility produced by high-pass noise masking on cortical event-related potentials to speech sounds /ba/ and /da/J Acoust Soc Am, 101 (1997), pp. 1585-1599
- Massaro, 1970Retroactive interference in short-term recognition memory for pitchJ Exp Psychol, 83 (1970), pp. 32-39
- Mathiak et al., 1999Preattentive processing of consonant vowel syllables at the level of the supratemporal plane: a whole-head magnetoencephalography studyCogn Brain Res, 8 (1999), pp. 251-257
- Mathiak et al., 2002Mismatch responses to randomized gradient switching noise as reflected by fMRI and whole-head magnetoencephalographyHuman Brain Map, 16 (2002), pp. 190-195
- Maurer et al., 2003aAltered responses to tone and phoneme mismatch in kindergartners at familial dyslexia riskNeuroReport, 14 (2003), pp. 2245-2250
- Maurer et al., 2003bDevelopment of the automatic mismatch response: from frontal positivity in kindergarten children to the mismatch negativityClin Neurophysiol, 114 (2003), pp. 808-817
- McGee et al., 1996Acoustic elements of speechlike stimuli are reflected in surface recorded responses over the guinea pig temporal lobeJ Acoust Soc Am, 99 (1996), pp. 3606-3614
- McGee et al., 1997Is it really a mismatch negativity? An assessment of methods for determining response validity in individual subjectsElectroencephalogr Clin Neurophysiol, 104 (1997), pp. 359-368
- McGurk and MacDonald, 1976Hearing lips and seeing voicesNature, 264 (1976), pp. 651-667
- McKenzie and Barry, 2006The independence of memory traces of attended and unattended stimuliCereb Cortex, 16 (2006), pp. 1566-1570
- Menning et al., 2002Plasticity of the human auditory cortex induced by discrimination learning of non-native, Mora-timed contrasts of the Japanese languageLearn Mem, 9 (2002), pp. 253-267
- Menning et al., 2000Plastic changes in the auditory cortex induced by intensive frequency discrimination trainingNeuroReport, 11 (2000), pp. 817-822
- Menning et al., 2005Pre-attentive detection of syntactic and semantic errorsNeuroReport, 16 (2005), pp. 77-80
- Micheyl et al., 2003The neurophysiological basis of the auditory continuity illusion: a mismatch negativity studyJ Cogn Neurosci, 15 (2003), pp. 747-758
- Michie et al., 2000Duration and frequency mismatch negativity in schizophreniaClin Neurophysiol, 111 (2000), pp. 1054-1065
- Minagawa-Kawai et al., 2004Differential cortical responses in second language learners to different vowel contrastsNeuroReport, 15 (2004), pp. 899-903
- Mohr and Pulvermüller, 2002Redundancy gains and costs in cognitive processing: effects of short stimulus onset asynchroniesJ Exp Psychol/Learn, Mem Cogn, 28 (2002), pp. 1200-1223
- Molholm et al., 2002Multisensory auditory–visual interactions during early sensory processing in humans: a high-density electrical mapping studyCogn Brain Res, 14 (2002), pp. 115-128
- Molholm et al., 2005The neural circuitry of pre-attentive auditory change-detection: an fMRI study of pitch and duration mismatch negativity generatorsCereb Cortex, 15 (2005), pp. 545-551
- Moore, 1989An introduction to the psychology of hearingAcademic Press, London (1989)
- Morlet et al., 2000Mismatch negativity and N100 monitoring: potential clinical value and methodological advancesAudiol Neuro-Otol, 5 (2000), pp. 198-206
- Morr et al., 2002Maturation of mismatch negativity in typically developing infants and preschool childrenEar Hear, 23 (2002), pp. 118-136
- Möttönen et al., 2002Processing of changes in visual speech in the human auditory cortexCognitive Brain Research, 13 (2002), pp. 417-425
- Müller et al., 2002Cortical activation to auditory mismatch elicited by frequency deviant and complex novel sounds: a PET studyNeuroImage, 17 (2002), pp. 231-239
- Müller and Schröger, 2007Temporal grouping affects the automatic processing of deviant soundsBiol Pschol, 74 (2007), pp. 358-364
- Müller et al., 2005aDeviance-repetition effects as a function of stimulus feature, feature value variation, and timing: a mismatch negativity studyBiol Psychol, 68 (2005), pp. 1-14
- Müller et al., 2005bAuditory streaming affects the processing of successive deviant and standard soundsPsychophysiology, 42 (2005), pp. 668-676
- Muller-Gass et al., 2005“…and were instructed to read a self-selected book while ignoring the auditory stimuli”: the effects of task demands on the mismatch negativityClin Neurophysiol, 116 (2005), pp. 2142-2152
- Muller-Gass et al., 2006The effect of visual task difficulty and attentional direction on the detection of acoustic change as indexed by the mismatch negativityBrain Res, 1078 (2006), pp. 112-130
- Münte et al., 1998Brain potentials and syntactic violations revisited: no evidence for specificity of the syntactic positive shiftNeuropsychologia, 36 (1998), pp. 217-226
- Münte et al., 2002The musician’s brain as a model of plasticityNat Rev Neurosci, 3 (2002), pp. 473-478
- Näätänen, 1975Selective attention and evoked potentials in humans - a critical reviewBiological Psychology, 2 (1975), pp. 237-307
- Näätänen, 1979Orienting and Evoked PotentialsH.D. Kimmel, E.H. van Olst, J.F. Orlebeke (Eds.), The orienting reflex in humans, Erlbaum, New Jersey (1979), pp. 61-75
- Näätänen, 1982Processing negativity: an evoked-potential reflection of selective attentionPsychol Bull, 92 (1982), pp. 605-640
- Näätänen, 1984Näätänen R. In search of a short-duration memory trace of a stimulus in the human brain. In: Pulkkinen L, Lyytinen P, editors. Human action and personality. Essays in honour of Martti Takala. Jyväskylä Studies in education, psychology and social Research, vol. 54. Jyväskylä, Finland: University of Jyväskylä;1984. p. 22–36.
- Näätänen, 1985Selective attention and stimulus processing: reflections in event-related potentials, magnetoencephalogram, and regional cerebral blood flowM.I. Posner, O.S.M. Marin (Eds.), Attention and performance, vol. XI, Erlbaum, Hillsdale, NJ (1985), pp. 355-373
- Näätänen, 1988Implications of ERP data for psychological theories of attentionBiol Psychol, 26 (1988), pp. 117-163
- Näätänen, 1990The role of attention in auditory information processing as revealed by event-related potentials and other brain measures of cognitive functionBehav Brain Sci, 13 (1990), pp. 201-288
- Näätänen, 1991Mismatch negativity (MMN) outside strong attentional focus: a commentary on Woldorff et alPsychophysiology, 28 (1991), pp. 478-484
- Näätänen, 1992Attention and brain functionLawrence Erlbaum Associates, Hillsdale, NJ (1992)
- Näätänen, 1995The mismatch negativity - a powerful tool for cognitive neuroscienceEar Hear, 16 (1995), pp. 6-18
- Näätänen, 2001The perception of speech sounds by the human brain as reflected by the mismatch negativity (MMN) and its magnetic equivalent MMNmPsychophysiology, 38 (2001), pp. 1-21(Presidential Address)
- Näätänen and Alho, 1995Mismatch negativity-a unique measure of sensory processing in auditionInt J Neurosci, 80 (1995), pp. 317-337
- Näätänen and Alho, 1997Mismatch negativity-the measure for central sound representation accuracyAudiol Neuro-Otol, 2 (1997), pp. 341-353
- Näätänen and Gaillard, 1983The orienting reflex and the N2 deflection of the event-related potential (ERP)A.W.K. Gaillard, W. Ritter (Eds.), Tutorials in event related potential research: endogenous components, Amsterdam, North Holland (1983), pp. 119-141
- Näätänen and Michie, 1979Early selective attention effects on the evoked potential. A critical review and reinterpretationBiol Psychol, 8 (1979), pp. 81-136
- Näätänen and Picton, 1987The N1 wave of the human electric and magnetic response to sound: a review and an analysis of component structurePsychophysiology, 24 (1987), pp. 375-425
- Näätänen and Rinne, 2002Electric brain response to sound repetition in humans: an index of long-term-memory-trace formation?Neurosci Lett, 318 (2002), pp. 49-51
- Näätänen and Winkler, 1999The concept of auditory stimulus representation in neurosciencePsychol Bull, 125 (1999), pp. 826-859
- Näätänen et al., 1978Early selective-attention effect on evoked potential reinterpretedActa Psychol, 42 (1978), pp. 313-329
- Näätänen et al., 1982Stimulus deviance and evoked potentialsBiol Psychol, 14 (1982), pp. 53-98
- Näätänen et al., 1987aNäätänen R, Paavilainen P, Alho K, Reinikainen K, Sams M. Interstimulus interval and the mismatch negativity. In: Evoked Potentials III, The Third International Evoked Potentials Symposium (Eds. C. Barber, & T. Blum) 1987, pp. 392–397. Butterworths, Boston.
- Näätänen et al., 1989bDo event-related potentials to infrequent decrements in duration of auditory stimuli demonstrate a memory trace in man?Neuroscience Letters, 107 (1989), pp. 347-352
- Näätänen et al., 1987bThe mismatch negativity to intensity changes in an auditory stimulus sequenceElectroencephalogr Clin Neurophysiol, suppl. 40 (1987), pp. 125-131
- Näätänen et al., 1988Frequency and location specificity of the human vertex N1 waveElectroencephalogr Clin Neurophysiol, 69 (1988), pp. 523-531
- Näätänen et al., 1989aDo event-related potentials reveal the mechanism of the auditory sensory memory in the human brain?Neurosci Lett, 98 (1989), pp. 217-221
- Näätänen et al., 1993aAttention and mismatch negativityPsychophysiology, 30 (1993), pp. 436-450
- Näätänen et al., 1993bDevelopment of a memory trace for a complex sound in the human brainNeuroReport, 4 (1993), pp. 503-506
- Näätänen et al., 1993cEvent-related potentials reveal a memory trace for temporal featuresNeuroReport, 5 (1993), pp. 310-312
- Näätänen et al., 1997Language-specific phoneme representations revealed by electric and magnetic brain responsesNature, 385 (1997), pp. 432-434
- Näätänen et al., 2001“Primitive intelligence” in the auditory cortexTrends Neurosci, 24 (2001), pp. 283-288
- Näätänen et al., 2004aThe mismatch negativity (MMN) - towards the optimal paradigmClin Neurophysiol, 115 (2004), pp. 140-144
- Näätänen et al., 2004bAutomatic time perception in the human brain for intervals ranging from milliseconds to secondsPsychophysiology, 41 (2004), pp. 660-663
- Näätänen et al., 2005Memory based or afferent processes in mismatch negativity (MMN): a review of the evidencePsychophysiology, 42 (2005), pp. 25-32
- Nager et al., 2003aTracking of multiple sound sources defined by interaural time differences: brain potential evidence in humansNeuroscience Letters, 344 (2003), pp. 181-184
- Nager et al., 2003bPreattentive evaluation of multiple perceptual streams in human auditionNeuroReport, 14 (2003), pp. 871-874
- Nashida et al., 2000Automatic auditory information processing in sleepSleep, 23 (2000), pp. 1-8
- Nelken, 2004Processing of complex stimuli and natural scenes in the auditory cortexCurr Opin Neurobiol, 14 (2004), pp. 474-480
- Nenonen et al., 2003Linguistic relevance of duration within the native language determines the accuracy of speech-sound duration processingCogn Brain Res, 16 (2003), pp. 492-495
- Nenonen et al., 2005Speech-sound duration processing in a second language is specific to phonetic categoriesBrain Lang, 92 (2005), pp. 26-32
- Neville et al., 1992Fractionating language: different neural subsystems with different sensitive periodsCerebral Cortex, 2 (1992), pp. 244-258
- Neville et al., 1991Syntactically based sentence processing classes: evidence from event-related brain potentialsJournal of Cognitive Neuroscience, 3 (1991), pp. 151-165
- Newman et al., 2003Influence of phonological expectations during a phoneme deletion task: Evidence from event-related potentialsPsychophysiology, 40 (2003), pp. 640-647
- Nielsen-Bohlman et al., 1991Differential auditory processing continues during sleepElectroencephalogr Clin Neurophysiol, 79 (1991), pp. 281-290
- Nittono et al., 2001The vanishing point of the mismatch negativity at sleep onsetClin Neurophysiol, 112 (2001), pp. 732-739
- Nordby et al., 1988aEvent-related potentials to breaks in sequences of alternating pitches or interstimulus intervalsPsychophysiology, 25 (1988), pp. 262-268
- Nordby et al., 1988bEvent-related potentials to time-deviant and pitch-deviant tonesPsychophysiology, 25 (1988), pp. 249-261
- Nordby et al., 1991ERPs to infrequent omissions and inclusions of stimulus elementsPsychophysiology, 28 (1991), p. S42
- Nordby et al., 1994ERPs for infrequent omissions and inclusions of stimulus elementsPsychophysiology, 31 (1994), pp. 544-552
- Nousak et al., 1996Storage of information in transient auditory memoryCogn Brain Res, 4 (1996), pp. 305-317
- Novak et al., 1992Mismatch detection and the latency of temporal judgementsPsychophysiology, 29 (1992), pp. 398-411
- Novak et al., 1990Differentiation of negative event-related potentials in an auditory discrimination taskElectroencephalogr Clin Neurophysiol, 7 (1990), pp. 255-275
- Novitski et al., 2004Frequency discrimination at different frequency levels as indexed by electrophysiological and behavioral measuresCogn Brain Res, 20 (2004), pp. 26-36
- Novitski et al., 2007Neonatal frequency discrimination in 250–4000 Hz frequency range: electrophysiological evidenceClin Neurophysiol, 118 (2007), pp. 412-419
- Nyman et al., 1990Mismatch negativity (MMN) for sequences of auditory and visual stimuli: evidence for a mechanism specific to the auditory modalityElectroencephalogr Clin Neurophysiol, 77 (1990), pp. 436-444
- Oades and Dittman-Balcar, 1995Mismatch negativity (MMN) is altered by directing attentionNeuroReport, 6 (1995), pp. 1187-1190
- Oades et al., 1997Development and topography of auditory event-related potentials (ERPs): mismatch and processing negativity in individuals 8–22 years of agePsychophysiology, 34 (1997), pp. 677-693
- Oceák et al., 2006Loudness summation and the mismatch negativity event-related brain potential in humansPsychophysiology, 43 (2006), pp. 13-20
- Öhman, 1979The orienting response, attention and learning: an information-processing perspectiveH.D. Kimmel, E.H. van Olst, J.F. Orlebeke (Eds.), The orienting reflex in humans, Lawrence Erlbaum, Hillsdale, NJ (1979), pp. 443-471
- Opitz et al., 1999Combined electrophysiological and hemodynamic measures of the auditory oddballPsychophysiology, 36 (1999), pp. 142-147
- Opitz et al., 2002Differential contribution of frontal and temporal cortices to auditory change detection: fMRI and ERP resultsNeuroImage, 15 (2002), pp. 165-174
- Opitz et al., 2005Sensory and cognitive mechanisms for preattentive change detection in auditory cortexEur J Neurosci, 21 (2005), pp. 531-535
- Osterhout et al., 1997Brain potentials elicited by words: word length and frequency predict the latency of an early negativityBiol Psychol, 46 (1997), pp. 143-168
- Otten et al., 2000Effects of visual attentional load on auditory processingNeuroReport, 11 (2000), pp. 875-880
- Paavilainen et al., 1989Mismatch negativity to change in the spatial location of an auditory stimulusElectroencephalogr Clin Neurophysiol, 73 (1989), pp. 129-141
- Paavilainen et al., 1991Right-hemisphere dominance of different mismatch negativitiesElectroencephalogr Clin Neurophysiol, 78 (1991), pp. 466-479
- Paavilainen et al., 2007Preattentive detection of nonsalient contingencies between auditory featuresNeuroReport, 18 (2007), pp. 159-163
- Paavilainen et al., 1993bMismatch negativity to slight pitch changes outside strong attentional focusBiol Psychol, 37 (1993), pp. 23-41
- Paavilainen et al., 1993aStimulus duration and the sensory memory trace: an event-related potential studyBiol Psychol, 35 (1993), pp. 139-152
- Paavilainen et al., 1998Binaural information can converge in abstract memory tracesPsychophysiology, 35 (1998), pp. 483-487
- Paavilainen et al., 1995Mismatch negativity to changes in abstract sound features during dichotic listeningJ Psychophysiol, 9 (1995), pp. 243-249
- Paavilainen et al., 1999Neuronal populations in the human brain extracting invariant relationships from acoustic varianceNeurosci Lett, 265 (1999), pp. 179-182
- Paavilainen et al., 2003aSpectral and temporal stimulus characteristics in the processing of abstract auditory featuresNeuroReport, 14 (2003), pp. 715-718
- Paavilainen et al., 2003bEvidence for the different additivity of the temporal and frontal generators of mismatch negativity: a human auditory event-related potential studyNeurosci Lett, 349 (2003), pp. 79-82
- Pakarinen et al., 2007Measurement of extensive auditory discrimination profiles using mismatch negativity (MMN) of the auditory event-related potentialClin Neurophysiol, 118 (2007), pp. 177-185
- Pang and Taylor, 2000Tracking the development of the N1 from age 3 to adulthood: an examination of speech and non-speech stimuliClin Neurophysiol, 111 (2000), pp. 388-397
- Pardo and Sams, 1993Human auditory cortex responses to rising versus falling glidesNeuroscience Letters, 159 (1993), pp. 43-45
- Pause and Krauel, 2000Chemosensory event-related potentials (CSERP) as a key to the psychology of odorsInt J Psychophysiol, 36 (2000), pp. 105-122
- Pazo-Alvarez et al., 2003MMN in the visual modality: a reviewBiol Psychol, 63 (2003), pp. 199-236
- Pekkonen, 2000Mismatch negativity in aging and in Alzheimer’s and Parkinson’s diseasesAudiol Neuro-Otol, 5 (2000), pp. 216-224
- Pekkonen et al., 2001Preserved stimulus deviance detection in Alzheimer’s diseaseNeuroReport, 1 (2001), pp. 1649-1652
- Pekkonen et al., 2005Cholinergic modulation of preattentive auditory processing in agingNeuroImage, 27 (2005), pp. 387-392
- Pekkonen et al., 2001Auditory sensory memory and the cholinergic system: implications for Alzheimer’s diseaseNeuroImage, 14 (2001), pp. 376-382
- Pekkonen et al., 1994Auditory sensory memory impairment in Alzheimer’s disease: an event-related potential studyNeuroReport, 5 (1994), pp. 2537-2540
- Pekkonen et al., 1995Variability and replicability of the mismatch negativityElectroencephalogr Clin Neurophysiol, 96 (1995), pp. 546-554
- Pekkonen et al., 1996Aging effects on auditory processing: an event-related potential studyExp Aging Res, 22 (1996), pp. 171-184
- Peltola et al., 2003Native and foreign vowel discrimination as indexed by the mismatch negativity (MMN) responseNeuroscience Letters, 352 (2003), pp. 25-28
- Pettigrew et al., 2004aThe relationship between the mismatch negativity (MMN) and psycholinguistic models of spoken word processingAphasiology, 18 (2004), pp. 3-28
- Pettigrew et al., 2005The mismatch negativity (MMN) response to complex tones and spoken words in individuals with aphasiaAphasiology, 19 (2005), pp. 131-163
- Pettigrew et al., 2004bAutomatic auditory processing of English words as indexed by the mismatch negativity, using a multiple deviant paradigmEar Hear, 25 (2004), pp. 284-301
- Phillips, 2001Levels of representation in the electrophysiology of speech perceptionCogn Sci, 25 (2001), pp. 711-731
- Phillips et al., 1995Brain mechanisms of speech perception: a preliminary reportT. Schütze, J.B. Ganger, K. Broihier (Eds.), Papers on language processing and acquisition, MIT Press, Cambridge, MA (1995), pp. 153-191
- Phillips et al., 2000Auditory cortex accesses phonological categories: an MEG mismatch studyJ Cogn Neurosci, 12 (2000), pp. 1038-1055
- Picton et al., 2000Mismatch negativity: different water in the same river [Review]Audiol Neuro-Otol, 5 (2000), pp. 111-139
- Pihko et al., 2005Magnetic fields evoked by speech sounds in preschool childrenClin Neurophysiol, 116 (2005), pp. 112-119
- Pihko et al., 1999Cortical responses of infants with and without and genetic risk for dyslexia; I. Age effectsNeuroReport, 10 (1999), pp. 901-905
- Pincze et al., 2001Separation of mismatch negativity and the N1 wave in the auditory cortex of the cat: a topographic studyClin Neurophysiol, 112 (2001), pp. 778-784
- Pincze et al., 2002Effect of deviant probability and interstimulus/interdeviant interval on the auditory N1 and mismatch negativity in the cat auditory cortexCogn Brain Res, 13 (2002), pp. 249-253
- Polo et al., 1999Mismatch negativity and auditory sensory memory in chronic alcoholicsAlcohol: Clin Exp Res, 23 (1999), pp. 1744-1750
- Ponton et al., 1997Integrated mismatch negativity (MMN): a noise-free representation of evoked responses allowing single-point distribution-free statistical testsElectroencephalogr Clin Neurophysiol, 104 (1997), pp. 143-150
- Ponton et al., 2000aMaturation of the mismatch negativity: effects of profound deafness and cochlear implant useAudiol Neuro-Otol, 5 (2000), pp. 167-185
- Ponton et al., 2002Maturation of human central auditory system activity: separating auditory evoked potentials by dipole source modellingClin Neurophysiol, 113 (2002), pp. 407-420
- Ponton et al., 2000bMaturation of human central auditory system activity: evidence from multi-channel evoked potentialsClin Neurophysiol, 111 (2000), pp. 220-236
- Port, 1991Can complex temporal patterns be automatized?Behav Brain Sci, 14 (1991), pp. 762-764
- Praamstra and Stegeman, 1992On the possibility of independent activation of bilateral mismatch negativity (MMN) generatorsElectroencephalogr Clin Neurophysiol, 82 (1992), pp. 67-80
- Price, 2000The anatomy of language: contributions from functional neuroimagingJ Anat, 197 (2000), pp. 335-359
- Pulvermüller, 1999Words in the human brain’s languageBehav Brain Sci, 22 (1999), pp. 253-336
- Pulvermüller, 2001Brain reflections of words and their meaningTrends Cogn Sci, 5 (2001), pp. 517-524
- Pulvermüller, 2005Brain mechanisms linking language and actionNature Neuroscience, 6 (2005), pp. 576-582
- Pulvermüller and Shtyrov, 2006Language outside the focus of attention: The mismatch negativity as a tool for studying higher cognitive processesProgress in Neurobiology, 79 (2006), pp. 49-71
- Pulvermüller et al., 2004Word-specific cortical activity as revealed by the mismatch negativity (MMN)Psychophysiology, 41 (2004), pp. 106-112
- Pulvermüller et al., 1995Electrocortical distinction of vocabulary typesElectroencephalogr Clin Neurophysiol, 94 (1995), pp. 357-370
- Pulvermüller, 2002A brain perspective on language mechanisms: from discrete neuronal ensembles to serial orderProg Neurobiol, 67 (2002), pp. 85-111
- Pulvermüller and Mohr, 1996The concept of transcortical cell assemblies: a key to the understanding of cortical lateralization and interhemispheric interactionNeurosci Behav Rev, 20 (1996), pp. 557-566
- Pulvermüller and Shtyrov, 2003Automatic processing of grammar in the human brain as revealed by the mismatch negativityNeuroImage, 20 (2003), pp. 159-172
- Pulvermüller et al., 2001aMemory traces for words as revealed by the mismatch negativityNeuroImage, 14 (2001), pp. 607-616
- Pulvermüller et al., 2001bWalking or talking?: behavioral and neurophysiological correlates of action verb processingBrain Lang, 78 (2001), pp. 143-168
- Pulvermüller et al., 2003Spatiotemporal dynamics of neural language processing: an MEG study using minimum-norm current estimatesNeuroImage, 20 (2003), pp. 1020-1025
- Pulvermüller et al., 2005Functional links between motor and language systemsEur J Neurosci, 21 (2005), pp. 793-797
- Raij et al., 1997Human auditory cortex is activated by omissions of auditory stimuliBrain Res, 745 (1997), pp. 134-143
- Ranganath and Rainer, 2003Neural mechanisms for detecting and remembering novel eventsNature Reviews in Neuroscience, 4 (2003), pp. 193-202
- Renault and Lesévre, 1978Topographical study of the emitted potential obtained after the omission of an expected visual stimulusD. Otto (Ed.), Multidiscliplinary perspectives in event-related brain potential research, EPA 600/9-77-043, U.S. Government Printing Office, Washington (1978), pp. 02-208
- Renault and Lesévre, 1979A trial-by-trial study of the visual omission response in reaction time situationsD. Lehmann, E. Callaway (Eds.), Human evoked potentials, Plenum Press, New York (1979), pp. 317-329
- Restuccia et al., 2005Attentional load of the primary task influences the frontal but not the temporal generators of mismatch negativityCogn Brain Res, 25 (2005), pp. 891-899
- Revonsuo et al., 1998Semantic processing of spoken words in Alzheimer’s disease: An electrophysiological studyJournal of Cognitive Neuroscience, 10 (1998), pp. 408-420
- Riekkinen et al., 1997THA disrupts mismatch negativity in Alzheimer diseasePsychopharmacology, 133 (1997), pp. 203-206
- Rinne et al., 1999aAnalysis of speech sounds is left-hemisphere predominant at 100–150 ms after sound onsetNeuroReport, 10 (1999), pp. 1113-1117
- Rinne et al., 2000Separate time behaviors of the temporal and frontal mismatch negativity sourcesNeuroimage, 12 (2000), pp. 14-19
- Rinne et al., 2001MMN is unaffected by top-down predictive informationNeuroReport, 12 (2001), pp. 2209-2213
- Rinne et al., 2005Superior temporal and inferior frontal cortices are activated by infrequent sound duration decrements: an fMRI studyNeuroImage, 26 (2005), pp. 66-72
- Rinne et al., 1999bScalp-recorded optical signals make sound processing in the auditory cortex visibleNeuroImage, 10 (1999), pp. 620-624
- Rinne et al., 2006Two separate mechanisms underlie auditory change detection and involuntary control of attentionBrain Res, 1077 (2006), pp. 135-143
- Ritter et al., 1995The mismatch negativity of event-related potentials as a probe of transient auditory memory: a reviewEar Hear, 16 (1995), pp. 52-67
- Ritter et al., 1992Event-related potentials to repetition and change of auditory stimuliElectroencephalogr Clin Neurophysiol, 83 (1992), pp. 306-321
- Ritter et al., 1999Two cognitive systems simultaneously prepared for opposite eventsPsychophysiology, 36 (1999), pp. 835-838
- Ritter et al., 2000Evidence that the mismatch negativity system works on the basis of objectsNeuroReport, 11 (2000), pp. 61-63
- Ritter et al., 2002Memory reactivation or reinstatement and the mismatch negativityPsychophysiology, 39 (2002), pp. 158-165
- Rivera-Gaxiola et al., 2000Electrophysiological correlates of category goodnessBehav Brain Res, 112 (2000), pp. 1-11
- Rivera-Gaxiola et al., 2005Brain potentials to native and non-native speech contrasts in 7- and 11-month-old American infantsDev Sci, 8 (2005), pp. 162-172
- Roeber et al., 2003aAuditory distraction with different presentation rates: an event-related potential and behavioral studyClin Neurophysiol, 114 (2003), pp. 341-349
- Roeber et al., 2003bAuditory distraction by duration and location deviants: a behavioral and event-related potential studyCogn Brain Res, 17 (2003), pp. 347-357
- Roman et al., 2005Relationship between auditory perception skills and mismatch negativity recorded in free field in cochlear-implant usersHear Res, 201 (2005), pp. 10-20
- Rosanovski et al., 1999Speech detection as revealed by the late auditory evoked N170 potentialFolia Otorhinolaryngol, 1–2 (1999), pp. 13-20
- Rosburg, 2003Left hemispheric dipole locations of the neuromagnetic mismatch negativity to frequency, intensity and duration deviantsCogn Brain Res, 16 (2003), pp. 83-90
- Rosburg, 2004Effects of tone repetition on auditory evoked neuromagnetic fieldsClin Neurophysiol, 115 (2004), pp. 898-905
- Rosburg et al., 2004aThe dipole location shift within the auditory evoked neuromagnetic field components N100m and mismatch negativity (MMNm)Clin Neurophysiol, 115 (2004), pp. 906-913
- Rosburg et al., 2004bEffects of lorazepam on the neuromagnetic mismatch negativity (MMNm) and auditory evoked field component N100mNeuropsychopharmacology, 29 (2004), pp. 1723-1733
- Rosburg et al., 2005Subdural recordings of the mismatch negativity (MMN) in patients with focal epilepsyBrain, 128 (2005), pp. 819-828
- Ross et al., 1996Neural mechanisms of the octave illusion: electrophysiological evidence for central originNeuroReport, 8 (1996), pp. 303-306
- Rüsseler et al., 2001Event-related brain potentials to sound omissions differ in musicians and non-musiciansNeurosci Lett, 308 (2001), pp. 33-36
- Ruusuvirta, 1999From spatial acoustic changes to attentive behavioral responses within 200 ms in humansNeuroscience Letters, 275 (1999), pp. 49-52
- Ruusuvirta et al., 1995Hippocampal event-related potentials to pitch deviances in an auditory oddball situation in the cat: experiment IInt J Psychophysiol, 20 (1995), pp. 33-39
- Ruusuvirta et al., 1998Auditory cortical event-related potentials to pitch deviances in ratsNeurosci Lett, 248 (1998), pp. 45-48
- Ruusuvirta et al., 2003The newborn human brain binds sound features togetherNeuroReport, 14 (2003), pp. 2117-2119
- Ruusuvirta et al., 2004Newborn human brain identifies repeated auditory feature conjunctions of low sequential probabilityEur J Neurosci, 20 (2004), pp. 2819-2821
- Saarinen et al., 1992Representation of abstract stimulus attributes in human brainNeuroReport, 3 (1992), pp. 1149-1151
- Sable et al., 2003Sound presentation rate is represented logarithmically in human cortexEur J Neurosci, 17 (2003), pp. 2492-2496
- Sabri and Campbell, 2001Effects of sequential and temporal probability of deviant occurrence on mismatch negativityCogn Brain Res, 12 (2001), pp. 171-180
- Sabri et al., 2004Neural correlates of auditory sensory memory and automatic change detectionNeuroImage, 21 (2004), pp. 69-74
- Sallinen et al., 1994Is the appearance of mismatch negativity during stage 2 sleep related to the elicitation of K-complex?Electroencephalogr Clin Neurophysiol, 91 (1994), pp. 140-148
- Sallinen et al., 1996Processing of auditory stimuli during tonic and phasic periods of REM sleep as revealed by event-related brain potentialsJ Sleep Res, 5 (1996), pp. 220-228
- Sallinen and Lyytinen, 1997Mismatch negativity during objective and subjective sleepinessPsychophysiology, 34 (1997), pp. 694-702
- Sambeth et al., 2006Newborns discriminate novel from harmonic sounds: a study using magnetoencephalographyClin Neurophysiol, 117 (2006), pp. 496-503
- Sams et al., 1991aSeeing speech: visual information from lip movements modifies activity in the human auditory cortexNeuroscience Letters, 127 (1991), pp. 141-145
- Sams et al., 1983Sequential effects on the ERP in discriminating two stimuliBiol Psychol, 17 (1983), pp. 41-58
- Sams et al., 1984Short-term habituation and dishabituaton of the mismatch negativity of the ERPPsychophysiology, 21 (1984), pp. 434-441
- Sams et al., 1990Event-related potentials to infrequent changes in synthesized phonetic stimuliJ Cogn Neurosci, 2 (1990), pp. 344-357
- Sams et al., 1993The human auditory sensory memory trace persists about 10 s: neuromagnetic evidenceJ Cogn Neurosci, 5 (1993), pp. 363-370
- Sams et al., 1985bCerebral neuromagnetic responses evoked by short auditory stimuliElectroencephalogr Clin Neurophysiol, 61 (1985), pp. 254-266
- Sams et al., 1985aAuditory frequency discrimination and event-related potentialsElectroencephalogr Clin Neurophysiol, 62 (1985), pp. 437-448
- Sams and Näätänen, 1991Neuromagnetic responses of the human auditory cortex to short frequency glidesNeurosci Lett, 121 (1991), pp. 43-46
- Sams et al., 1991bCortical activity elicited by changes in auditory stimuli: different sources for the magnetic N100m and mismatch responsesPsychophysiology, 28 (1991), pp. 21-29
- Sandridge and Boothroyd, 1996Using naturally produced speech to elicit the mismatch negativityJ Am Acad Audiol, 7 (1996), pp. 105-112
- Sato et al., 2000The effect of deviant stimulus probability on the human mismatch processNeuroReport, 11 (2000), pp. 3703-3708
- Sato et al., 2002Impairment in activation of a frontal attention-switch mechanism in schizophrenic patientsBiological Psychology, 62 (2002), pp. 49-63
- Savela et al., 2003The mismatch negativity and reaction time as indices of the perceptual distance between the corresponding vowels of two related languagesCogn Brain Res, 16 (2003), pp. 250-256
- Schall et al., 2003Functional neuroanatomy of auditory mismatch processing: an event-related fMRI study of duration-deviant oddballsNeuroImage, 20 (2003), pp. 729-736
- Scharf and Houtsma, 1986Audition II. Loudness, pitch, localization, aural disortion, pathologyHandbook of perception and human performanceK.R. Boff, L. Kaufman, J.P. Thomas (Eds.), Sensory processes and perception, vol. 1, Wiley, New York (1986), pp. 15.1-15.60
- Scherg et al., 1989A source analysis of the late human auditory evoked potentialsJ Cogn Neurosci, 1 (1989), pp. 336-355
- Schröger, 1994An event-related potential study of sensory representations of unfamiliar tonal patternsPsychophysiology, 31 (1994), pp. 175-181
- Schröger, 1995Processing of auditory deviants with changes in one versus two stimuli dimensionsPsychophysiology, 32 (1995), pp. 55-65
- Schröger, 1996aA neural mechanism for involuntary attention shifts to changes in auditory stimulationJ Cogn Neurosci, 8 (1996), pp. 527-539
- Schröger, 1996bThe influence of stimulus intensity and inter-stimulus interval on the detection of pitch and loudness changesElectroencephalogr Clin Neurophysiol, 100 (1996), pp. 517-526
- Schröger, 1997On the detection of auditory deviants: a pre-attentive activation modelPsychophysiology, 34 (1997), pp. 245-257
- Schröger et al., 2000Auditory distraction: event-related potential and behavioral indicesClin Neurophysiol, 111 (2000), pp. 1450-1460
- Schröger et al., 1992Event-related potentials reveal how non-attended complex sound patterns are represented by the human brainNeurosci Lett, 146 (1992), pp. 183-186
- Schröger et al., 1994Mismatch negativity to changes in a continuous tone with regularly varying frequenciesElectroencephalogr Clin Neurophysiol, 92 (1994), pp. 140-147
- Schröger et al., 1995Time course of loudness in tone patterns is automatically represented by the human brainNeurosci Lett, 202 (1995), pp. 117-120
- Schröger et al., 1996Preattentive periodicity detection in auditory patterns as governed by time and intensity informationCogn Brain Res, 4 (1996), pp. 145-148
- Schröger and Wolff, 1996Mismatch response of the human brain to changes in sound locationNeuroReport, 7 (1996), pp. 3005-3009
- Schröger and Wolff, 1998aAttentional orienting and reorienting is indicated by human event-related brain potentialsNeuroreport, 9 (1998), pp. 3355-3358
- Schröger and Wolff, 1998bBehavioral and electrophysiological effects of task-irrelevant sound change: a new distraction paradigmCogn Brain Res, 7 (1998), pp. 71-87
- Sevostianov et al., 2002Effect of attention on central auditory processing: an fMRI studyInt J Neurosci, 112 (2002), pp. 587-606
- Shafer et al., 2000Maturation of mismatch negativity in school-age childrenEar Hear, 21 (2000), pp. 242-251
- Shafer et al., 2004Language-specific memory traces of consonants in the brainCogn Brain Res, 18 (2004), pp. 242-254
- Shanks and St. John, 1994Characteristics of dissociable human learning systemsBehav Brain Sci, 17 (1994), pp. 367-447
- Sharma and Dorman, 1999Cortical auditory evoked potential correlates of categorical perception of voice-onset timeJ Acoust Soc Am, 106 (1999), pp. 1078-1083
- Sharma and Dorman, 2000Neurophysiologic correlates of cross-language phonetic perceptionJ Acoust Soc Am, 107 (2000), pp. 2697-2703
- Sharma and Kraus, 1995Effects of contextual variations in pitch and phonetic processing: neurophysiologic correlates [Abstract]Assoc Res Otalaryngol, 729 (1995), p. 183
- Sharma et al., 1994Physiologic bases of pitch and place of articulation perception: A case studyJ Acoust Soc Am, 95 (1994), p. 3011
- Sharma et al., 1993Acoustic versus phonetic representation of speech as reflected by mismatch negativity event-related potentialElectroencephalogr Clin Neurophysiol, 88 (1993), pp. 64-71
- Shestakova et al., 2002aInvoluntary attention in children as a function of sound source location: evidence from event-related potentialsClin Neurophysiol, 113 (2002), pp. 162-168
- Shestakova et al., 2002bAbstract phoneme representations in the left temporal cortex: magnetic mismatch negativity studyNeuroReport, 13 (2002), pp. 1813-1816
- Shinozaki et al., 2003Spectrotemporal window of integration of auditory information in the human brainCogn Brain Res, 17 (2003), pp. 563-571
- Shinozaki et al., 2000Mismatch negativity (MMN) reveals sound grouping in the human brainNeuroReport, 11 (2000), pp. 1597-1601
- Shinozaki et al., 1998Somatosensory automatic responses to deviant stimuliCogn Brain Res, 7 (1998), pp. 165-171
- Shtyrov et al., 2004Distributed neuronal networks for encoding category-specific semantic information: the mismatch negativity to action wordsEur J Neurosci, 19 (2004), pp. 1083-1092
- Shtyrov et al., 1998Background acoustic noise and the hemispheric lateralization of speech processing in the human brain: magnetic mismatch negativity studyNeurosci Lett, 251 (1998), pp. 141-144
- Shtyrov et al., 1999Noise affects speech-signal processing differently in the cerebral hemispheresNeuroReport, 10 (1999), pp. 2189-2192
- Shtyrov et al., 2000Lateralization of speech processing in the brain as indicated by the mismatch negativity and dichotic listeningBrain Cogn, 43 (2000), pp. 392-398
- Shtyrov et al., 2005Determinants of dominance: is language laterality explained by physical or linguistic features of speech?NeuroImage, 27 (2005), pp. 37-47
- Shtyrov and Pulvermüller, 2002aMemory traces for inflectional affixes as shown by mismatch negativityEur J Neurosci, 15 (2002), pp. 1085-1091
- Shtyrov and Pulvermüller, 2002bNeurophysiological evidence of memory traces for words in the human brainNeuroReport, 13 (2002), pp. 521-525
- Shtyrov et al., 2003Grammar processing outside the focus of attention: an MEG studyJ Cogn Neurosci, 15 (2003), pp. 1195-1206
- Simoens et al., 2007Psychosocial stress attenuates general sound processing and duration change detectionPsychophysiology, 44 (2007), pp. 30-38
- Sittiprapaporn et al., 2003Pre-attentive processing of lexical tone perception by the human brain as indexed by the mismatch negativity (MMN)Ann N Y Acad Sci, 999 (2003), pp. 199-203
- Skrandies, 1998Evoked potential correlates of semantic meaning – a brain mapping studyCogn Brain Res, 6 (1998), pp. 173-183
- Sokolov et al., 2002The orienting response in information processingErlbaum, Mahwah, NJ (2002)368 pp
- Sonnadara et al., 2006aEffects of spatial separation and stimulus probability on the event-related potentials elicited by occasional changes in sound locationBrain Res, 1076 (2006), pp. 175-185
- Sonnadara et al., 2006bOccasional changes in sound location enhance middle latency-evoked responsesBrain Res, 1076 (2006), pp. 187-192
- Spiegel and Watson, 1981Factors in the discrimination of tonal patterns: III. Frequency discrimination with components of well-learned patternsJ Acoust Soc Am, 69 (1981), pp. 223-230
- Squires et al., 1975Two varieties of long-latency positive waves evoked by unpredictable auditory stimuli in manElectroencephalography and clinical Neurophysiology, 38 (1975), pp. 387-401
- Stagg et al., 2004Visual mismatch negativity: The detection of stimulus changeNeuroreport, 15 (2004), pp. 659-663
- Stekelenburg et al., 2004Illusory sound shifts induced by the ventriloquist illusion evoke the mismatch negativityNeurosci Lett, 357 (2004), pp. 163-166
- Stuss and Benson, 1986The frontal lobesRaven Press, New York (1986)
- Stuss and Knight, 2002D.T. Stuss, R.T. Knight (Eds.), Principles of frontal lobe function, Oxford University Press, New York (2002)
- Sussman, 2005Integration and segregation in auditory scene analysisJ Acoust Soc Am, 117 (2005), pp. 1285-1298
- Sussman et al., 2005Attentional modulation of electrophysiological activity in auditory cortex for unattended sounds in multi-stream auditory environmentsCogn Affect Behav Neurosci, 5 (2005), pp. 93-110
- Sussman and Gumenyuk, 2005Organization of sequential sounds in auditory memoryNeuroReport, 16 (2005), pp. 1519-1523
- Sussman and Steinschneider, 2006Neurophysiological evidence for context-dependent encoding of sensory input in human auditory cortexBrain Res, 1075 (2006), pp. 165-174
- Sussman et al., 1998aAttention affects the organization of auditory input associated with the mismatch negativity systemBrain Res, 789 (1998), pp. 130-138
- Sussman et al., 1998bPredictability of stimulus deviance and the mismatch negativityNeuroReport, 9 (1998), pp. 4167-4170
- Sussman and Winkler, 2001Dynamic sensory updating in the auditory systemCogn Brain Res, 12 (2001), pp. 431-439
- Sussman et al., 1999Temporal integration of auditory stimulus deviance as reflected by the mismatch negativityNeurosci Lett, 264 (1999), pp. 161-164
- Sussman et al., 2002aTop–down effects on stimulus-driven auditory organizationCogn Brain Res, 13 (2002), pp. 393-405
- Sussman et al., 2002bTemporal integration: intentional sound discrimination does not modulate stimulus-driven processes in auditory event synthesisClin Neurophysiol, 113 (2002), pp. 1909-1920
- Sussman et al., 2003aRepresentation of the standard: Stimulus context effects on the process generating the mismatch negativity component of event-related brain potentialsPsychophysiology, 40 (2003), pp. 465-471
- Sussman et al., 2003bTop–down control over involuntary attention switching in the auditory modalityPsychon Bull Rev, 10 (2003), pp. 630-637
- Sussman et al., 2003cMMN and attention: competition for deviance detectionPsychophysiology, 40 (2003), pp. 430-435
- Sussman et al., 2004Automatic and controlled processing of acoustic and phonetic contrastsHear Res, 190 (2004), pp. 128-140
- Sutton et al., 1965Evoked-potential correlates of stimulus uncertaintyScience, 150 (1965), pp. 1187-1188
- Szymanski et al., 1999Phonemes, intensity and attention: Differential effects on the mismatch negativity (MMN)J Acoust Soc Am, 106 (1999), pp. 3492-3505
- Takegata and Morotomi, 1999Integrated neural representation of sound and temporal features in human auditory sensory memory: an event-related potential studyNeurosci Lett, 274 (1999), pp. 207-210
- Takegata et al., 1999Independent processing of changes in auditory single features and feature conjunctions in humans as indexed by the mismatch negativity (MMN)Neurosci Lett, 266 (1999), pp. 109-112
- Takegata et al., 2001aPreattentive processing of spectral, temporal and structural characteristics of acoustic regularities: a mismatch negativity studyPsychophysiology, 38 (2001), pp. 92-98
- Takegata et al., 2001bChanges in acoustic features and their conjunctions are processed by separate neuronal populationsNeuroReport, 12 (2001), pp. 525-529
- Takegata et al., 2001cCommon neural mechanisms for processing onset-to-onset intervals and silent gaps in sound sequenceNeuroReport, 12 (2001), pp. 1783-1787
- Takegata et al., 2005aPreattentive representation of feature conjunctions for simultaneous, spatially distributed auditory objectsCogn Brain Res, 25 (2005), pp. 169-179
- Takegata et al., 2005bEffects of temporal grouping on the memory representation of inter-tone relationshipsBiol Psychol, 68 (2005), pp. 41-60
- Tales et al., 1999Mismatch negativity in the visual modalityNeuroReport, 110 (1999), pp. 3363-3367
- Tallal et al., 1993Neurobiological basis of speech: a case for the pre-eminence of temporal processingAnn N.Y. Acad Sci, 682 (1993), pp. 27-47
- Tanaka et al., 2001A study of mismatch negativity in newbornsPediatr Int, 43 (2001), pp. 281-286
- Tata and Ward, 2005Early phase of spatial mismatch negativity is localized to a posterior “where” auditory pathwayExp Brain Res, 167 (2005), pp. 481-486
- Tervaniemi and Brattico, 2004From sounds to music. Towards understanding the neurocognition of musical sound perceptionJ Conscious Stud, 11 (2004), pp. 9-27
- Tervaniemi and Hugdahl, 2003Lateralization of auditory-cortex functionsBrain Res Rev, 43 (2003), pp. 231-246
- Tervaniemi et al., 2006Selective tuning of cortical sound-feature processing by language experienceEur J Neurosci, 23 (2006), pp. 2538-2541
- Tervaniemi et al., 2005bPitch discrimination accuracy in musicians vs nonmusicians: an event-related potential and behavioural studyExp Brain Res, 161 (2005), pp. 1-10
- Tervaniemi et al., 1999Functional specialization of the human auditory cortex in processing phonetic and musical sounds: a magnetoencephalographic (MEG) studyNeuroImage, 10 (1999), pp. 330-336
- Tervaniemi et al., 2000aLateralized automatic auditory processing of phonetic versus musical information: a PET studyHuman Brain Map, 10 (2000), pp. 74-79
- Tervaniemi et al., 2001Superior formation of cortical memory traces for melodic patterns in musiciansLearn Mem, 8 (2001), pp. 295-300
- Tervaniemi et al., 2000bEffects of spectral complexity and sound duration on automatic complex-sound pitch processing in humans – a mismatch negativity studyNeurosci Lett, 290 (2000), pp. 66-70
- Tervaniemi et al., 2005aTest–retest stability of the magnetic mismatch response (MMNm)Clin Neurophysiol, 116 (2005), pp. 1897-1905
- Tervaniemi et al., 1994aNeural representations of abstract stimulus features in the human brain as reflected by the mismatch negativityNeuroReport, 5 (1994), pp. 844-846
- Tervaniemi et al., 1994bTemporal integration of auditory information in sensory memory as reflected by the mismatch negativityBiol Psychol, 38 (1994), pp. 157-167
- Tervaniemi et al., 1997aThe musical brain: brain waves reveal the neurophysiological basis of musicalityNeurosci Lett, 226 (1997), pp. 1-4
- Tervaniemi et al., 1997bPre-attentive categorization of sounds by timbre as revealed by event-related potentialsNeuroReport, 8 (1997), pp. 2571-2574
- Tiitinen et al., 1993Tonotopic auditory cortex and the magnetoencephalographic (MEG) equivalent of the mismatch negativityPsychophysiology, 30 (1993), pp. 537-540
- Tiitinen et al., 1994Attentive novelty detection in humans is governed by pre-attentive sensory memoryNature, 370 (1994), pp. 90-92
- Titova and Näätänen, 2001Preattentive voice discrimination by the human brain as indexed by the mismatch negativityNeuroscience Letters, 308 (2001), pp. 63-65
- Todd and Michie, 2000Do perceived loudness cues contribute to duration mismatch negativity (MMN)?NeuroReport, 11 (2000), pp. 3771-3774
- Toiviainen et al., 1998Timbre similarity: convergence of neural, behavioral, and computational approachesMusic Percept, 16 (1998), pp. 223-241
- Trainor et al., 2002Automatic and controlled processing of melodic contour and interval information measured by electrical brain activityJ Cogn Neurosci, 14 (2002), pp. 430-442
- Trainor et al., 2003Changes in auditory cortex and the development of mismatch negativity between 2 and 6 months of ageInt J Psychophysiol, 51 (2003), pp. 5-15
- Treisman, 1988Features and objects: the fourteenth Bartlett memorial lectureJ Exp Psychol, 40A (1988), pp. 201-237
- Treisman and Gelade, 1980A feature-integration theory of attentionCogn Psychol, 12 (1980), pp. 97-136
- Treisman and Sato, 1990Conjunction search revisitedJ Exp Psychol: Human Percept Perform, 16 (1990), pp. 459-478
- Trejo et al., 1995Attentional modulation of the mismatch negativity elicited by frequency differences between binaurally presented tone burstsPsychophysiology, 32 (1995), pp. 319-328
- Tremblay and Kraus, 2002Auditory training induces asymmetrical changes in cortical neural activityJ Speech, Lang, Hear Res, 45 (2002), pp. 564-572
- Tremblay et al., 1997Central auditory system plasticity: Generalization to novel stimuli following listening trainingJ Acoust Soc Am, 102 (1997), pp. 3762-3773
- Tremblay et al., 1998The time course of auditory perceptual learning: neurophysiological changes during speech-sound trainingNeuroReport, 9 (1998), pp. 3557-3560
- Trueswell et al., 1993Verb-specific constraints in sentence processing: Separating effects of lexical preference from garden-pathsJournal of Experimental Psychology: Learning, Memory, and Cognition, 19 (1993), pp. 528-553
- Tse et al., 2006Event-related optical imaging reveals the temporal and frontal cortex activation in pre-attentive change detectionNeuroImage, 29 (2006), pp. 314-320
- Ulanovsky et al., 2003Processing of low-probability sounds by cortical neuronsNature Neurosci, 6 (2003), pp. 391-398
- Ullsperger et al., 2006When sound and picture do not fit: mismatch negativity and sensory interactionInt J Psychophysiol, 59 (2006), pp. 3-7
- Umbricht et al., 2002Mismatch negativity predicts psychotic experiences induced by NMDA receptor antagonist in healthy volunteersBiological Psychiatry, 51 (2002), pp. 400-406
- Umbricht et al., 2005Deviant-related electrophysiological activity in mice: is there mismatch negativity in mice?Clin Neurophysiol, 116 (2005), pp. 353-363
- Uther et al., 2003Mismatch negativity indexes auditory temporal resolution: evidence from event-related potential (ERP) and event-related field (ERF) recordingsCogn Brain Res, 17 (2003), pp. 685-691
- Uwer and Von Suchodoletz, 2000Stability of mismatch negativities in childrenClinical Neurophysiology, 111 (2000), pp. 45-52
- van den Brink et al., 2001Electrophysiological evidence for early contextual influences during spoken-word recognition: N200 versus N400 effectsJournal of Cognitive Neuroscience, 13 (2001), pp. 967-985
- van Zuijen et al., 2005Auditory organization of sound sequences by a temporal or numerical regularity-a mismatch negativity study comparing musicians and non-musiciansCogn Brain Res, 23 (2005), pp. 270-276
- van Zuijen et al., 2004Grouping of sequential sounds-an event-related potential study comparing musicians and nonmusiciansJ Cogn Neurosci, 16 (2004), pp. 331-338
- Vaz Pato and Jones, 1999Cortical processing of complex tone stimuli: mismatch negativity at the end of a period of rapid pitch modulationCogn Brain Res, 7 (1999), pp. 295-306
- Vihla and Eulitz, 2003Topography of the auditory evoked potential in humans reflects differences between vowels embedded in pseudo-wordsNeurosci Lett, 338 (2003), pp. 189-192
- Vihla et al., 2000Cortical processing of change detection: dissociation between natural vowels and two-frequency complex tonesProc Natl Acad Sci, 97 (2000), pp. 10590-10594
- Vuust et al., 2005To musicians, the message is in the meter. Pre-attentive neuronal responses to incongruent rhythm are left-lateralized in musiciansNeuroImage, 24 (2005), pp. 560-564
- Waberski et al., 2001Spatio-temporal source imaging reveals subcomponents of the human auditory mismatch negativity in the cingulum and right inferior temporal gyrusNeurosci Lett, 308 (2001), pp. 107-110
- Wable et al., 2000Mismatch negaitivty: a tool for the assessment of stimuli discrimination in cochlear implant subjectsClin Neurophysiol, 111 (2000), pp. 743-751
- Walker et al., 2001Possible neuronal refractory or recovery artifacts associated with recording the mismatch negativity responseJ Am Acad Audiol, 12 (2001), pp. 348-356
- Wang et al., 2005bERP correlates of involuntary attention capture by prosodic salience in speechPsychophysiology, 42 (2005), pp. 43-55
- Wang et al., 2005aThe development of the length of the temporal window of integration for rapidly presented auditory information as indexed by MMNClin Neurophysiol, 116 (2005), pp. 1695-1706
- Weber et al., 2004Discrimination of word stress in early infant perception: electrophysiological evidenceCogn Brain Res, 18 (2004), pp. 149-161
- Whalen and Liberman, 1987Speech perception takes precedence over nonspeech perceptionScience, 237 (1987), pp. 169-171
- Wible et al., 2001A functional magnetic resonance imaging study of auditory mismatch in schizophreniaAm J Psychiatry, 158 (2001), pp. 938-943
- Wijnen et al., 2007Mismatch negativity predicts recovery from the vegetative stateClin Neurophysiol, 118 (2007), pp. 597-605
- Winkler and Näätänen, 1992Event-related potentials in auditory backward recognition masking: a new way to study the neurophysiological basis of sensory memory in humansNeurosci Lett, 140 (1992), pp. 239-242
- Winkler et al., 1993Event-related brain potentials reflect echoic memory in humansPercept Psychophys, 53 (1993), pp. 443-449
- Winkler and Näätänen, 1994The effects of auditory backward masking on event-related brain potentialsElectroencephalogr Clin Neurophysiol, 44 (1994), pp. 185-189
- Winkler and Schröger, 1995Neural representation for the temporal structure of sound patternsNeuroReport, 6 (1995), pp. 690-694
- Winkler and Czigler, 1998Mismatch negativity: deviance detection or the maintenance of the “standard”NeuroReport, 9 (1998), pp. 3809-3813
- Winkler and Cowan, 2004From sensory to long-term memory: evidence from auditory memory reactivation studiesExp Psychol, 51 (2004), pp. 1-17
- Winkler et al., 1990The effect of small variation of the frequent auditory stimulus on the event-related brain potential to the infrequent stimulusPsychophysiology, 27 (1990), pp. 228-235
- Winkler et al., 1992Can echoic memory store two traces simultaneously? A study of event-related brain potentialsPsychophysiology, 29 (1992), pp. 337-349
- Winkler et al., 1995From objective to subjective: pitch representation in the human auditory cortexNeuroReport, 6 (1995), pp. 2317-2320
- Winkler et al., 1996aInteractions between transient and long-term auditory memory as reflected by the mismatch negativityJ Cogn Neurosci, 8 (1996), pp. 403-415
- Winkler et al., 1996bAdaptive modeling of the unattended acoustic environment reflected in the mismatch negativity event-related potentialBrain Res, 742 (1996), pp. 239-252
- Winkler et al., 1997Two separate codes for missing-fundamental pitch in the human auditory cortexJ Acoust Soc Am, 102 (1997), pp. 1072-1082
- Winkler et al., 1998Temporal constraints of auditory event synthesis: evidence from ERPsNeuroReport, 9 (1998), pp. 495-499
- Winkler et al., 1999aPre-attentive detection of vowel contrasts utilizes both phonetic and auditory memory representationsCogn Brain Res, 7 (1999), pp. 357-369
- Winkler et al., 1999bBrain responses reveal the learning of foreign language phonemesPsychophysiology, 36 (1999), pp. 638-642
- Winkler et al., 2003bNewborn infants can organize the auditory worldProceedings of the National Academy of Sciences, 100 (2003), pp. 11812-11815
- Winkler and Näätänen, 1993Event-related brain potentials to infrequent partial omissions in series of auditory stimuliH.-J. Heinze, T.F. Münte, G.R. Mangun (Eds.), New Developments in Event-Related Potentials, Birkhäuser, Boston-Basel-Berlin (1993), pp. 219-226
- Winkler et al., 2001The role of large-scale perceptual organization in the mismatch negativity event-related brain potentialJ Cogn Neurosci, 13 (2001), pp. 59-71
- Winkler et al., 2003cHuman auditory cortex tracks task-irrelevant sound sourcesNeuroReport, 14 (2003), pp. 2053-2056
- Winkler, Kujala et al., 2003aLanguage context and phonetic change detectionCogn Brain Res, 17 (2003), pp. 833-844
- Winkler et al., 2005Preattentive binding of auditory and visual stimulus featuresJ Cogn Neurosci, 17 (2005), pp. 320-339
- Wolff and Schröger, 2001aActivation of the auditory pre-attentive change detection system by tone repetitions with fast simulation rateCogn Brain Res, 10 (2001), pp. 323-327
- Wolff and Schröger, 2001bHuman pre-attentive auditory change-detection with single, double and triple deviations as revealed by mismatch negativity additivityNeurosci Lett, 311 (2001), pp. 37-40
- Woldorff and Hillyard, 1991Modulation of early auditory processing during selective listening to rapidly presented tonesElectroencephalogr Clin Neurophysiol, 79 (1991), pp. 170-191
- Woldorff et al., 1987Evidence for effects of selective attention in the mid-latency range of the human auditory event-related brain potentialR. Johnson Jr., J.W. Rohrbaugh, R. Parasuraman (Eds.), Current trends in event-related brain potential research, Elsevier, Amsterdam (1987), pp. 146-154Suppl. 40 to Electroencephalogr Clin Neurophysiol
- Woldorff et al., 1991The effects of channel-selective attention on the mismatch negativity wave elicited by deviant tonesPsychophysiology, 28 (1991), pp. 30-42
- Woldorff et al., 1998Magnetoencephalographic recordings demonstrate attentional modulation of mismatch-related neural activity in human auditory cortexPsychophysiology, 35 (1998), pp. 283-292
- Woods et al., 1992Intermodal selective attention I: effects on event-related potentials to lateralized auditory and visual stimuliElectroencephalogr Clin Neurophysiol, 82 (1992), pp. 341-355
- Woods et al., 1994Stages of auditory feature conjunction: an event-related brain potential studyJ Exp Psychol Hum Percept Perform, 20 (1994), pp. 81-94
- Wunderlich and Cone-Wesson, 2001Effects of stimulus frequency and complexity on the mismatch negativity and other components of the cortical auditory-evoked potentialJ Acoust Soc Am, 109 (2001), pp. 1526-1537
- Yabe, 2002Discriminative sensitivity inside temporal window of sensory memoryInt Cong Ser, 1232 (2002), pp. 219-224
- Yabe et al., 2001aAutomatic discriminative sensitivity inside temporal window of sensory memory as a function of timeCogn Brain Res, 12 (2001), pp. 39-48
- Yabe et al., 2005aTime may be compressed in sound representation as replicated in sensory memoryNeuroReport, 16 (2005), pp. 95-98
- Yabe et al., 2005bTransient gamma-band response is dissociated from sensory memory as reflected by MMNNeurosci Lett, 380 (2005), pp. 80-82
- Yabe et al., 1997Temporal window of integration revealed by MMN to sound omissionNeuroReport, 8 (1997), pp. 1971-1974
- Yabe et al., 1998Temporal window of integration of auditory information in the human brainPsychophysiology, 35 (1998), pp. 615-619
- Yabe et al., 2001bOrganizing sound sequences in the human brain: the interplay of auditory streaming and temporal integrationBrain Res, 897 (2001), pp. 222-227
- Yago et al., 2001aActivation of brain mechanisms of attention switching as a function of auditory frequency changeNeuroReport, 12 (2001), pp. 4093-4097
- Yago et al., 2001bCerebral mechanisms underlying orienting of attention towards auditory frequency changesNeuroreport, 12 (2001), pp. 2583-2587
- Ylinen et al., 2005Phoneme quality and quantiy are processed independently in the human brainNeuroReport, 16 (2005), pp. 1857-1860
- Ylinen et al., 2006Mismatch negativity (MMN) elicited by changes in phoneme lenght: a cross-linguistic studyBrain Res, 1072 (2006), pp. 175-185
- Yppärilä et al., 2002Evidence of auditory processing during postoperative propofol sedationClinical Neurophysiology, 113 (2002), pp. 1357-1364
- Yucel et al., 2005aVisual task complexity modulates the brain’s response to unattended auditory noveltyNeuroReport, 16 (2005), pp. 1031-1036
- Yucel et al., 2005bGraded visual attention modulates brain responses evoked by task-irrelevant auditory pitch changesJ Cogn Neurosci, 17 (2005), pp. 1819-1828
- Zatorre et al., 1994Neural mechanisms underlying melodic perception and memory for pitchJ Neurosci, 14 (1994), pp. 1908-1919
- Zatorre and Belin, 2001Spectral and temporal processing in human auditory cortexCereb Cortex, 11 (2001), pp. 946-953
- Zhang et al., 2006The effect of visuospatial attentional load on the processing of irrelevant acoustic distractorsNeuroImage, 33 (2006), pp. 715-724
- Zhang et al., 2005Effects of language experience: neural commitment to language-specific auditory patternsNeuroImage, 26 (2005), pp. 703-720
- Zhang et al., 2000Zhang Y, Kuhl PK, Imada T, Iverson P, Pruitt J, Kotani M, Stevens E. Neural plasticity revealed in perceptual training of a Japanese adult listener to learn American /l-r/ contrast: a whole-head magnetoencephalography study. Sixth International Conference on Spoken Language Processing. Institute for Learning and Brain Sciences, University of Washington, 2000.
- Zwicker and Fastl, 1990Psychoacoustics: facts and modelsSpringer-Verlag, Berlin (1990)
Cited by (1834)
Understanding the neural mechanisms for infants' perception of native and non-native speech
2023, Brain and LanguageStimulus-specific adaptation (SSA) in the auditory system: Functional relevance and underlying mechanisms
2023, Neuroscience and Biobehavioral ReviewsAuditory evoked response to an oddball paradigm in children wearing cochlear implants
2023, Clinical NeurophysiologyAge differences in central auditory system responses to naturalistic music
2023, Biological Psychology